Volume IO usage gets reset to 0 after a reboot / crash

Bug #1169097 reported by Michael Kerrin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
Low
Michael Kerrin
Grizzly
Fix Released
Low
Ruby Loo

Bug Description

There is a lose of information in the volume usage after a reboot / crash of an instance.

Changed in nova:
assignee: nobody → Michael Kerrin (michael-kerrin-w)
Revision history for this message
Michael Kerrin (michael-kerrin-w) wrote :

To reproduce:

Watch volume.usage notifications.

Perform IO on volume and see notifications increase overtime.

Reboot the instance.

volume.usage notifications have been reset to 0.

The cumulative statistics about the IO performed in step 2 is lost. Customers will be undercharged on IO requests.

Changed in nova:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/26993
Committed: http://github.com/openstack/nova/commit/a4cb456631f0e70685fbc361eced9baa477a8c56
Submitter: Jenkins
Branch: master

commit a4cb456631f0e70685fbc361eced9baa477a8c56
Author: Michael Kerrin <email address hidden>
Date: Tue Apr 16 09:43:28 2013 +0000

    Volume IO usage gets reset to 0 after a reboot / crash

    Check for reset of block device stats before updating volume usage cache.

    If an instance is reboot or crashes, the results of block device stats for
    that domain get reset. Add check that if block device stats are lower than
    the current stats in the database, then add current values to totals and
    update.

    Change-Id: I3011872f8d80a1519771f8423001650dcbcc7f5b
    Fixes bug: 1169097

Changed in nova:
status: In Progress → Fix Committed
tags: added: grizzly-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/grizzly)

Fix proposed to branch: stable/grizzly
Review: https://review.openstack.org/30130

Thierry Carrez (ttx)
Changed in nova:
milestone: none → havana-1
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/grizzly)

Reviewed: https://review.openstack.org/30130
Committed: http://github.com/openstack/nova/commit/03c2429c3cf35c09941888c74d1a8dd47f37ad4e
Submitter: Jenkins
Branch: stable/grizzly

commit 03c2429c3cf35c09941888c74d1a8dd47f37ad4e
Author: Michael Kerrin <email address hidden>
Date: Tue Apr 16 09:43:28 2013 +0000

    Volume IO usage gets reset to 0 after a reboot / crash

    Check for reset of block device stats before updating volume usage cache.

    If an instance is reboot or crashes, the results of block device stats for
    that domain get reset. Add check that if block device stats are lower than
    the current stats in the database, then add current values to totals and
    update.

    Change-Id: I3011872f8d80a1519771f8423001650dcbcc7f5b
    Fixes bug: 1169097
    (cherry picked from commit a4cb456631f0e70685fbc361eced9baa477a8c56)

tags: added: in-stable-grizzly
Alan Pevec (apevec)
tags: removed: grizzly-backport-potential in-stable-grizzly
Changed in nova:
importance: Undecided → Low
Thierry Carrez (ttx)
Changed in nova:
milestone: havana-1 → 2013.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.