OpenStack Compute (nova)

Live-migration failed with OpenStack Icehouse and Ubuntu 12.04

Bug #1319710 reported by Chu Duc Minh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
New
Undecided
Unassigned

Bug Description

When I do live-migration an instance between two compute-nodes have the same CPU, i got the following error:
(@ nova-compute.log)

2014-05-15 15:39:21.563 2743 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: XML error: CPU feature `erms' specified
more than once
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", lin
e 133, in _dispatch_and_reply
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher incoming.message))
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", lin
e 176, in _dispatch
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", lin
e 122, in _do_dispatch
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrappe
d
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher payload)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", li
ne 68, in __exit__
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrappe
d
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in
 decorated_function
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info())
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", li
ne 68, in __exit__
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in
 decorated_function
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info())
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", li
ne 68, in __exit__
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 296, in
 decorated_function
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4418, in check_can_live_migrate_destination
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher block_migration, disk_over_commit)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4189, in check_can_live_migrate_destination
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher self._compare_cpu(source_cpu_info)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4331, in _compare_cpu
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher LOG.error(m, {'ret': ret, 'u': u})
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4327, in _compare_cpu
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher ret = self._conn.compareCPU(cpu.to_xml(), 0)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher rv = execute(f,*args,**kwargs)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher rv = meth(*args,**kwargs)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/libvirt.py", line 3191, in compareCPU
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher if ret == -1: raise libvirtError ('virConnectCompareCPU() failed', conn=self)
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher libvirtError: XML error: CPU feature `erms' specified more than once
2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher

I'm using Ubuntu 12.04 with Openstack Icehouse.
Version of components on compute-nodes:
nova* 1:2014.1-0ubuntu1~cloud0
libivrt* 1.2.2-0ubuntu13.1~cloud0

Tags: libvirt
Tracy Jones (tjones-i)
tags: added: compute
Revision history for this message
Michael Kazakov (gnomino) wrote :

https://bugs.launchpad.net/nova/+bug/1303536

Joe Gordon (jogo)
tags: added: libvirt
tags: removed: compute
Revision history for this message
Prateek khushalani (prateek-khushalani) wrote : Re: [Bug 1319710] Re: Live-migration failed with OpenStack Icehouse and Ubuntu 12.04
Download full text (7.2 KiB)

Hi,

its a bug it the code. The workaround is to comment the function in the
libvirt code which checks the flags of cpu while migration. Do make sure
manually that the cpu flags of both the compute nodes are same.

Regards,
Prateek Khushalani
On Jul 29, 2014 9:26 PM, "Rafael David Tinoco" <email address hidden>
wrote:

> ** This bug is no longer a duplicate of bug 1303536
> Live migration fails. XML error: CPU feature `wdt' specified more than
> once
>
> --
> You received this bug notification because you are subscribed to
> OpenStack.
> Matching subscriptions: Prateek Khushalani
> https://bugs.launchpad.net/bugs/1319710
>
> Title:
> Live-migration failed with OpenStack Icehouse and Ubuntu 12.04
>
> Status in OpenStack Compute (Nova):
> New
>
> Bug description:
> When I do live-migration an instance between two compute-nodes have the
> same CPU, i got the following error:
> (@ nova-compute.log)
>
> 2014-05-15 15:39:21.563 2743 ERROR oslo.messaging.rpc.dispatcher [-]
> Exception during message handling: XML error: CPU feature `erms' specified
> more than once
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> Traceback (most recent call last):
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", lin
> e 133, in _dispatch_and_reply
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> incoming.message))
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", lin
> e 176, in _dispatch
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> return self._do_dispatch(endpoint, method, ctxt, args)
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", lin
> e 122, in _do_dispatch
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> result = getattr(endpoint, method)(ctxt, **new_args)
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrappe
> d
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> payload)
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", li
> ne 68, in __exit__
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> six.reraise(self.type_, self.value, self.tb)
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrappe
> d
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher
> return f(self, context, *args, **kw)
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher File
> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 309, in
> decorated_function
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc.dispatcher e,
> sys.exc_info())
> 2014-05-15 15:39:21.563 2743 TRACE oslo.messaging.rpc....

Read more...

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on nova (master)

Change abandoned by Daniel Berrange (<email address hidden>) on branch: master
Review: https://review.openstack.org/93706
Reason: It is a duplicate with another already merged patch

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.