reschedule_or_reraise in cinder.volume.manager eats exception on base LVM driver

Bug #1159027 reported by John Griffith on 2013-03-23
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Cinder
High
Liang Chen
Grizzly
High
Chuck Short

Bug Description

In certain conditions the _reschedule_or_reraise method will eat the error message/exception from LVM create returning no free extents. The result is the command returns succesfully, a volume is created in the DB and listed as available.

In reality however no LVM was ever created, and the cinder-vol logs show a trace including the lvcreate failure.

Changed in cinder:
importance: Undecided → High
status: New → Triaged
Liang Chen (cbjchen) on 2013-04-04
Changed in cinder:
assignee: nobody → Liang Chen (cbjchen)
status: Triaged → In Progress
Edward Hope-Morley (hopem) wrote :

The proposed fix only partially solves the problem since. It does prevent the volume from entering the 'available' state but I notice that the volume now stays in 'creating' state indefinitely. I presume we would want the volume to go to 'error' after a finite number of re-schedules?

Liang Chen (cbjchen) wrote :

Yeah, you are right. The proposed fix only addresses the issue directly mentioned in this bug.

The reason why it stays in 'creating' state is that the scheduler cannot graceful handle the reschedule request because of another bug in volume manager. And I have already logged a bug for this problem.

Please take a look at https://bugs.launchpad.net/cinder/+bug/1164857.

Thanks.

Reviewed: https://review.openstack.org/26096
Committed: http://github.com/openstack/cinder/commit/b823de4370fb306de0416d8ec1c1a70ac224207c
Submitter: Jenkins
Branch: master

commit b823de4370fb306de0416d8ec1c1a70ac224207c
Author: Liang Chen <email address hidden>
Date: Thu Apr 4 23:39:54 2013 +0800

    leave re-scheduled volume status to creating

    A re-scheduled volume should not be exported and set to available

    Fixes bug #1159027

    Change-Id: Ie61d9132ce1bd6461d5e4d9836424ebf14100389

Changed in cinder:
status: In Progress → Fix Committed

Reviewed: https://review.openstack.org/26621
Committed: http://github.com/openstack/cinder/commit/59f11c9969200aada1fdcedb763c95fa8085181a
Submitter: Jenkins
Branch: stable/grizzly

commit 59f11c9969200aada1fdcedb763c95fa8085181a
Author: Liang Chen <email address hidden>
Date: Thu Apr 4 23:39:54 2013 +0800

    leave re-scheduled volume status to creating

    A re-scheduled volume should not be exported and set to available

    Fixes bug #1159027

    Change-Id: Ie61d9132ce1bd6461d5e4d9836424ebf14100389
    (cherry picked from commit b823de4370fb306de0416d8ec1c1a70ac224207c)

tags: added: in-stable-grizzly
Thierry Carrez (ttx) on 2013-05-29
Changed in cinder:
milestone: none → havana-1
status: Fix Committed → Fix Released
Alan Pevec (apevec) on 2013-08-06
tags: removed: in-stable-grizzly
Thierry Carrez (ttx) on 2013-10-17
Changed in cinder:
milestone: havana-1 → 2013.2
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers