VolumeIsBusy and SnapshotIsBusy shouldn't be ignored

Bug #1413750 reported by Ivan Kolodyazhny
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Cinder
New
Undecided
Rajat Dhasmana

Bug Description

During volume or snapshot deletion we catch VolumeIsBusy [1] and SnapshotIsBusy [2] and ignore them setting a 'available' state.

At least, we need to try once more to run delete action.

Maybe, setting state to 'error-deleting' is also acceptable if N tries failed.

[1] https://github.com/openstack/cinder/blob/ae5a7d5ea31fa14317696859b1e6e900ff740f26/cinder/volume/manager.py#L469
[2] https://github.com/openstack/cinder/blob/ae5a7d5ea31fa14317696859b1e6e900ff740f26/cinder/volume/manager.py#L612

Revision history for this message
John Griffith (john-griffith) wrote :

I agree, some things in progress I'd like to clean a lot of this up and have started with snapshot create. If I can get to the bottom of the seg-fault this introduces in the storwize tests I think we have a good general pattern to use to update all of the LVM calls.

Revision history for this message
Ivan Kolodyazhny (e0ne) wrote :

John, this is related for all backends. I found this issue with RDB (Ceph) driver

Ivan Kolodyazhny (e0ne)
Changed in cinder:
status: New → Confirmed
Changed in cinder:
assignee: nobody → Vilobh Meshram (vilobhmm)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/209156

Changed in cinder:
assignee: Vilobh Meshram (vilobhmm) → Yuriy Nesenenko (ynesenenko)
status: Confirmed → In Progress
Revision history for this message
Huang Zhiteng (zhiteng-huang) wrote :

Setting volume to 'error_deleting' means the volume won't be usable anymore (can't be attached, even deleted), it would require admin's intervention to do something about this volume. So I don't think it's a good idea to set a volume to 'error_deleting' just because it's been busy.

Revision history for this message
Jordan Pittier (jordan-pittier) wrote :

Yeah, the "error deleting" status is really a pain to deal with...

Revision history for this message
Yuriy Nesenenko (ynesenenko) wrote :

Add retries to delete volume or snapshot https://review.openstack.org/#/c/209156/
Now after N tries of volume (or snapshot) deletion failed it's setting state to 'available' if it's
been busy.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on cinder (master)

Change abandoned by Yuriy Nesenenko (<email address hidden>) on branch: master
Review: https://review.openstack.org/209156
Reason: Retries added in the RBD driver https://review.openstack.org/#/c/217746/ So such issues need to be addressed in the drivers themeselves.

Revision history for this message
javeme (javaloveme) wrote :

This problem would cause the user confused: we did not delete the volume/snapshot successfully, but it did not report any errors and not record any state.

it is far from enough to just print an error log!

Revision history for this message
Sean McGinnis (sean-mcginnis) wrote : Bug Assignee Expired

Unassigning due to no activity for > 6 months.

Changed in cinder:
assignee: Yuriy Nesenenko (ynesenenko) → nobody
Changed in cinder:
status: In Progress → New
Changed in cinder:
assignee: nobody → Rajat Dhasmana (whoami-rajat)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to cinder (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/589951

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Related fix proposed to branch: master
Review: https://review.openstack.org/597028

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on cinder (master)

Change abandoned by Rajat Dhasmana (<email address hidden>) on branch: master
Review: https://review.openstack.org/597028
Reason: Functionality not required.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to cinder (master)

Reviewed: https://review.openstack.org/589951
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=df41cd5173f4854f3dbd9b4460bc0813560aceb8
Submitter: Zuul
Branch: master

commit df41cd5173f4854f3dbd9b4460bc0813560aceb8
Author: whoami-rajat <email address hidden>
Date: Wed Aug 8 21:10:39 2018 +0530

    Add retries to delete a volume in the Nimble Driver

    Retrying to delete a volume for N tries and if
    failed we raise NimbleAPIException.

    Change-Id: I937147b7a4caf8480a8b7429effa545cd8926a8d
    Related-Bug: #1413750

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.