Cinder+LIO: Live migration failed.

Bug #1369541 reported by Ainur Shakirov
18
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
High
Tomoki Sekiyama

Bug Description

If uses cinder with LIO live migration in Nova failed.

I have three nodes: c0, c1 and c2.

Steps to reproduce:
1. Create a VM with boot from disk to one host (c0) or attach disk into VM.
2. Migrate this VM to another node (c1). Live migration is OK.
3. Again migrate a VM to host c0 -> error "iscsiadm: No session found" in the nova-compute log.
4. Migrate VM to node c2. Live migration is OK. Migration to c0 and c1 from c2 -> again "No session found".

Version of software (for all compute nodes):
Ubuntu 14.04.1 (up-to-date)
OpenStack Icehouse 2014.1.2 (with patch from https://bugs.launchpad.net/cinder/+bug/1361738)
Hypervisor: QEMU/KVM
iSCSI-target: LIO (LVM-based)

nova-compute log with error in the attachments.

Thank you for your answers!

WBR.
Ainur.

P.S. Please sorry for my English.

Revision history for this message
Ainur Shakirov (ainur-shakirov-tt) wrote :
Revision history for this message
Ainur Shakirov (ainur-shakirov-tt) wrote :

Added: cinder-volume.log

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/130399

Changed in cinder:
assignee: nobody → Tomoki Sekiyama (tsekiyama)
status: New → In Progress
Mike Perez (thingee)
Changed in cinder:
importance: Undecided → High
milestone: none → kilo-1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.openstack.org/130399
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=641a44eb17a8de53e54f09a2dc339129d41c529f
Submitter: Jenkins
Branch: master

commit 641a44eb17a8de53e54f09a2dc339129d41c529f
Author: Tomoki Sekiyama <email address hidden>
Date: Wed Oct 22 18:30:06 2014 -0400

    LioAdm: Delete initiator from targets on terminate_connection

    In current LioAdm implementation, initiators are remained even if
    terminate_connection is called. This keeps volumes exported to hosts
    after instances attaching the volumes are live-migrated to another
    host, which is not good for security. It also causes an error on the
    migration back to the original host, because cinder-rtstool doesn't
    update CHAP authentication if the initiator already exists.

    With this patch, initiators are deleted on terminate_conection.
    'initiator-delete' operation is added to cinder-rtstool.
    It makes the following live-migration succeed.
    Also, this adds unit tests for initialize_connection and
    terminate_connection methods in LioAdm.

    Change-Id: Ib273f0ba4f1ef553374c0433b049f18719f8c758
    Closes-Bug: #1369541

Changed in cinder:
status: In Progress → Fix Committed
Revision history for this message
Ainur Shakirov (ainur-shakirov-tt) wrote :

Thank you very much! I will test LM with LIO with this patch in this weekend.

Thierry Carrez (ttx)
Changed in cinder:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in cinder:
milestone: kilo-1 → 2015.1.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.