Nova live migration failed due to OLE error

Bug #1246592 reported by Ya Hong Du
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
High
Ya Hong Du
Havana
Fix Released
High
Ya Hong Du

Bug Description

When migrate vm on hyperV, command fails with the following error:

2013-10-25 03:35:40.299 12396 ERROR nova.openstack.common.rpc.amqp [req-b542e0fd-74f5-4e53-889c-48a3b44e2887 3a75a18c8b60480d9369b25ab06519b3 0d44e4afd3d448c6acf0089df2dc7658] Exception during message handling
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\openstack\common\rpc\amqp.py", line 461, in _process_data
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp **args)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\openstack\common\rpc\dispatcher.py", line 172, in dispatch
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\exception.py", line 90, in wrapped
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp payload)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\exception.py", line 73, in wrapped
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\compute\manager.py", line 4103, in live_migration
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp block_migration, migrate_data)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\driver.py", line 118, in live_migration
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp block_migration, migrate_data)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\livemigrationops.py", line 44, in wrapper
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp return function(self, *args, **kwds)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\livemigrationops.py", line 76, in live_migration
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp recover_method(context, instance_ref, dest, block_migration)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\livemigrationops.py", line 69, in live_migration
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp dest)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\livemigrationutils.py", line 231, in live_migrate_vm
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp disk_paths = self._get_physical_disk_paths(vm_name)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\livemigrationutils.py", line 114, in _get_physical_disk_paths
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp ide_paths = self._vmutils.get_controller_volume_paths(ide_ctrl_path)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\nova\virt\hyperv\vmutils.py", line 553, in get_controller_volume_paths
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp "parent": controller_path})
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\wmi.py", line 1009, in query
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp return [ _wmi_object (obj, instance_of, fields) for obj in self._raw_query(wql) ]
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp File "C:\Program Files (x86)\IBM\SmartCloud Entry\Hyper-V Agent\Python27\lib\site-packages\win32com\client\util.py", line 84, in next
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp return _get_good_object_(self._iter_.next(), resultCLSID = self.resultCLSID)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp com_error: (-2147217385, 'OLE error 0x80041017', None, None)
2013-10-25 03:35:40.299 12396 TRACE nova.openstack.common.rpc.amqp

Tags: hyper-v
Ya Hong Du (yahongdu)
Changed in nova:
assignee: nobody → Ya Hong Du (yahongdu)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (master)

Fix proposed to branch: master
Review: https://review.openstack.org/54677

GuoHui Liu (guohliu)
tags: added: hyper-v
tags: added: havana-backport-potential
Revision history for this message
Alessandro Pilotti (alexpilotti) wrote :

Hi, can you please post the log on paste.openstack.org and paste the link here?
It's really hard to read the logs inside of a bug description.

At a first glance, it looks like it fails when attaching the iSCSI volumes.
Can you please confirm if there are issues with live migration in case of instances with local storage only?

Beside that we need some additional context:

-OpenStack version
-Hyper-V version
-iSCSI volume solution used

Changed in nova:
importance: Undecided → Medium
Revision history for this message
Alessandro Pilotti (alexpilotti) wrote :

Just saw the fix proposed for review, no need for additional data anymore to triage the bug. Thanks.

Changed in nova:
status: In Progress → Triaged
importance: Medium → High
Changed in nova:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/54677
Committed: http://github.com/openstack/nova/commit/e74ceb68e1642d773f2ad0c655e6354f7a7fb362
Submitter: Jenkins
Branch: master

commit e74ceb68e1642d773f2ad0c655e6354f7a7fb362
Author: DuYaHong <email address hidden>
Date: Thu Oct 31 13:56:08 2013 +0800

    Fix OLE error for HyperV

    When run live-migration on HyperV, an OLE error
    will occur. This is because we use wrong WQL
    sentence when we try to query table
    'Msvm_ResourceAllocationSettingData'.

    This commit fixes the wrong WQL sentence.

    Closes-Bug: #1246592

    Change-Id: Iabb4096002a5be1fb930b077fbf5ef734893c258

Changed in nova:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/havana)

Fix proposed to branch: stable/havana
Review: https://review.openstack.org/55961

Changed in nova:
milestone: none → icehouse-1
Thierry Carrez (ttx)
Changed in nova:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/havana)

Reviewed: https://review.openstack.org/55961
Committed: http://github.com/openstack/nova/commit/d5409f210fb1f4d9e290c08e8b7e5e08eb82fad1
Submitter: Jenkins
Branch: stable/havana

commit d5409f210fb1f4d9e290c08e8b7e5e08eb82fad1
Author: DuYaHong <email address hidden>
Date: Thu Oct 31 13:56:08 2013 +0800

    Fix OLE error for HyperV

    When run live-migration on HyperV, an OLE error
    will occur. This is because we use wrong WQL
    sentence when we try to query table
    'Msvm_ResourceAllocationSettingData'.

    This commit fixes the wrong WQL sentence.

    Closes-Bug: #1246592

    Change-Id: Iabb4096002a5be1fb930b077fbf5ef734893c258
    (cherry picked from commit e74ceb68e1642d773f2ad0c655e6354f7a7fb362)

tags: added: in-stable-havana
Alan Pevec (apevec)
tags: removed: havana-backport-potential in-stable-havana
Thierry Carrez (ttx)
Changed in nova:
milestone: icehouse-1 → 2014.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.