Live-migration nova fails with qemu and libvirt

[Lucio Agostinho]

Hi,
I posted two messages to ask.ubuntu about my problem without solution:
https://ask.openstack.org/en/question/12033/live-migration-with-qemu-is-possible/
https://ask.openstack.org/en/question/12134/live-migration-with-qemu-is-really-possible/
and I reported the problem in #openstack. Until now, I can't find a solution.

I'm using Openstack Havana in CentOS. I've installed 1 controller and 2 compute nodes, with NFS. Controller folder is shared by the compute nodes (folder /var/lib/nova/instances). All nodes are accessible among them without password. I can perform a migration in the dashboard. In the shell, I exaustivelly tried live migration without sucess. I'm setting /etc/nova/nova.conf and uncomment all live-migration options. I'm trying the following in the shell:

# nova live-migration MY_UUID_VM_INSTANCE my_host_destine

But silenty this command not works.

Finally, my log of /var/log/nova-all.log:

---
<0>Feb 17 20:19:43 node-4 ¿<179>nova-nova.openstack.common.rpc.amqp ERROR: Exception during message handling
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
    **args)
  File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
    result = getattr(proxyobj, method)(ctxt, **kwargs)
  File "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped
    payload)
  File "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped
    return f(self, context, *args, **kw)
  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 4016, in pre_live_migration
    migrate_data)
  File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4162, in pre_live_migration
    self._create_images_and_backing(context, instance, instance_dir,
UnboundLocalError: local variable 'instance_dir' referenced before assignment
<0>Feb 17 20:20:16 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Auditing locally available compute resources
<0>Feb 17 20:20:16 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Free ram (MB): 1494
<0>Feb 17 20:20:16 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Free disk (GB): 14
<0>Feb 17 20:20:16 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Free VCPUS: 2
<0>Feb 17 20:20:16 node-4 ¿<182>nova-nova.compute.resource_tracker INFO: Compute_service record updated for node-4.domain.tld:node-4.domain.tld
<0>Feb 17 20:21:15 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Auditing locally available compute resources
<0>Feb 17 20:21:15 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Free ram (MB): 1494
<0>Feb 17 20:21:15 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Free disk (GB): 14
<0>Feb 17 20:21:15 node-4 ¿<180>nova-nova.compute.resource_tracker AUDIT: Free VCPUS: 2
<0>Feb 17 20:21:15 node-4 ¿<182>nova-nova.compute.resource_tracker INFO: Compute_service record updated for node-4.domain.tld:node-4.domain.tld

---

This is a bug? Someone could help me? I should use KVM instead qemu? Any help is usefull. Thanks in advance.

[Michael Still (mikal)]

I can't see how this could be happening by looking at the code (neither Havana nor master). What release of Havana are you running?

[Lucio Agostinho (outrosdiasvirao-n)]

Hi,
I solved this bug has follow:

https://bugs.launchpad.net/openstack-manuals/+bug/1280330

[zhangjinnan (zhang-jinnan)]

I have this problem in havana, solve problem as follow:
https://review.openstack.org/#/c/80275/

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/108404

[OpenStack Infra (hudson-openstack)]

Change abandoned by Dan Smith (<email address hidden>) on branch: master
Review: https://review.openstack.org/108404
Reason: Alternate patch proposed: https://review.openstack.org/#/c/108468/1

[Guangya Liu (Jay Lau) (jay-lau-513)]

It is duplicate with https://bugs.launchpad.net/nova/+bug/1346385

Though this bug was filed early then 1346385 but considering the fix for 1346385 is better, what about mark this as a duplicate one? Thanks.

[Lucio Agostinho (outrosdiasvirao-n)]

No. This should not be posted as a duplicated bug, because this bug is not fixed in the new 'old' ice house openstack version, yet.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Dan Smith (<email address hidden>) on branch: master
Review: https://review.openstack.org/108404

[Eli Qiao (taget-9)]

This may most likely resolved by https://review.openstack.org/#/c/91722

Beside, I can not reproduce it with nfs storage on my local environment.

Eli.

[lvmxh (shaohef)]

Eli
this should can reproduce.

And as you point: 91722 fix this bug.

[Eli Qiao (taget-9)]

hi lvmxh
I am sorry , I don't get you , you can reproduce this issue?

[lvmxh (shaohef)]

I means you can reproduce it before https://review.openstack.org/#/c/91722
And you should not reproduce it after https://review.openstack.org/#/c/91722