live migrate requires shared storage

[Ami Jeain]

I have a setup of 1 controller and 2 computes.
I have an instance which I try to live-migrate from one compute server to another, and It gives an error "failed to live migrate....".
I looked at the /var/log/nova/compute.log and it shows the following exception:

2014-02-09 12:05:14.072 19968 ERROR nova.openstack.common.rpc.amqp [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] Exception during message handling
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp **args)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/exception.py", line 90, in wrapped
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp payload)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp six.reraise(self.type_, self.value, self.tb)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/exception.py", line 73, in wrapped
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4083, in check_can_live_migrate_destination
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp block_migration, disk_over_commit)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3968, in check_can_live_migrate_destination
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp self._compare_cpu(source_cpu_info)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4110, in _compare_cpu
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp LOG.error(m, {'ret': ret, 'u': u})
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp six.reraise(self.type_, self.value, self.tb)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4106, in _compare_cpu
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp ret = self._conn.compareCPU(cpu.to_xml(), 0)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 187, in doit
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 147, in proxy_call
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp rv = execute(f,*args,**kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 76, in tworker
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp rv = meth(*args,**kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2889, in compareCPU
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp if ret == -1: raise libvirtError ('virConnectCompareCPU() failed', conn=self)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp libvirtError: XML error: CPU feature `pdpe1gb' specified more than once
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp
2014-02-09 12:05:14.076 19968 ERROR nova.openstack.common.rpc.common [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] Returning exception XML error: CPU feature `pdpe1gb' specified more than once to caller
2014-02-09 12:05:14.076 19968 ERROR nova.openstack.common.rpc.common [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n **args)\n', ' File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n result = getattr(proxyobj, method)(ctxt, **kwargs)\n', ' File "/usr/lib/python2.7/site-packages/nova/exception.py", line 90, in wrapped\n payload)\n', ' File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/site-packages/nova/exception.py", line 73, in wrapped\n return f(self, context, *args, **kw)\n', ' File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4083, in check_can_live_migrate_destination\n block_migration, disk_over_commit)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3968, in check_can_live_migrate_destination\n self._compare_cpu(source_cpu_info)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4110, in _compare_cpu\n LOG.error(m, {\'ret\': ret, \'u\': u})\n', ' File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4106, in _compare_cpu\n ret = self._conn.compareCPU(cpu.to_xml(), 0)\n', ' File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 187, in doit\n result = proxy_call(self._autowrap, f, *args, **kwargs)\n', ' File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 147, in proxy_call\n rv = execute(f,*args,**kwargs)\n', ' File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 76, in tworker\n rv = meth(*args,**kwargs)\n', ' File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2889, in compareCPU\n if ret == -1: raise libvirtError (\'virConnectCompareCPU() failed\', conn=self)\n', "libvirtError: XML error: CPU feature `pdpe1gb' specified more than once\n"]

[Justin Pomeroy (jpomero)]

Does this error only happen when using the dashboard, or can you reproduce from the command line? I have a feeling this might not be a horizon bug but maybe belongs under nova.

[Matthias Runge (mrunge)]

The issue is:
the error message given via command line is way more helpful than the more generic message in dashboard, which only says "failed to migrate"

[Matthias Runge (mrunge)]

Maybe it's a good solution, to de-activate the live-migrate option by default and only enable it via config option. Thus, a user of a cloud would not run into this specific issue.

[Julie Pichon (jpichon)]

What's the error message from the command-line in this case? I don't think it makes sense to add a setting for live migrate. It's not an extension and if it's properly configured it will work, just like any other command...

[Walter Heukels (gh-walter-3a)]

This seems to be the same issue as nova bug #1322681: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1322681

[Gary W. Smith (gary-w-smith)]

This bug was last updated over 3 years ago, and as it appears
to have been addressed in nova, this is getting marked as
Invalid. If the issue still exists, please feel free to reopen it.