Storage on hypervisors page incorrect for shared storage

[Adam Huffman]

The storage total and storage used shown on the Hypervisors page does not take account of the shared storage case.
We have shared storage for /var/lib/nova/instances (currently using Gluster) and Horizon computes a simple addition of the usage across the compute nodes. The total and used figures are incorrect.

[Yossi Ovadia (jabadia)]

+1
We face the same issue with ceph. I assume it's relevant to all shared file system.

[Julie Pichon (jpichon)]

Horizon displays the stats as returned by "nova hypervisor-stats" ("local_gb" and "local_gb_used"). Perhaps this is where the problem should be investigated, or maybe Horizon should update its terminology to make it clearer it's "local" storage only?

[Sean Dague (sdague)]

Not really a nova issue, shared storage accounting in the cluster is not really it's job.

[Julie Pichon (jpichon)]

Let's update the Horizon terminology to clarify this is local storage only.

https://github.com/openstack/horizon/blob/master/openstack_dashboard/dashboards/admin/hypervisors/tables.py
https://github.com/openstack/horizon/blob/master/openstack_dashboard/dashboards/admin/hypervisors/templates/hypervisors/index.html

[Chris Friesen (cbf123)]

Sean...I think it's a bit disingenuous to say that this isn't a nova issue. Nova can't have its cake and eat it too.

Currently nova is reporting values that don't actually mean anything. If nova isn't responsible for shared storage accounting, then it shouldn't return any data about things it doesn't know about.

On the other hand, if nova is going to report data and make decisions based on it (like in the scheduler DiskFilter) then it should ensure that the data is actually correct.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/128634

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/128634
Committed: https://git.openstack.org/cgit/openstack/horizon/commit/?id=84f78554f6277ecd8946e6e8e802366b9098aa44
Submitter: Jenkins
Branch: master

commit 84f78554f6277ecd8946e6e8e802366b9098aa44
Author: sagardmni <email address hidden>
Date: Wed Oct 15 17:57:28 2014 +0530

    Update Horizon terminology relating to storage

        Currently, although the Horizon Hypervisors page only shows
        local storage and not storage, this is unclear from the
        terminology. Add 'local' to the description to clarify
        that only local storage is being reported.

        Closes-Bug: #1352405

    Change-Id: Ic51d6cadc7a95ac1918d0cf7762600abe17941c0

[Željko Jagušt (zeljko-jagust)]

Guys, tell me if I'm wrong, but this ticket was about Horizon displaying incorrect value for SHARED storage total, and not about terminology. While I agree with a terminology, it is correct only when hypervisors have local storage, aka local disks for virtual machine disks.

In case of ceph, glusterfs or any other shared FS, this value is wrong. Also, it's worth to mention here that Ceph has replica sets so that also should be taken under consideration. If this is not something that can be solved, the best solution would be that disk usage total is not displayed under "Hypervisors" in horizon when shared FS is used.

[Kevin Olbrich (kevin-olbrich)]

I think the current situation does not realy make sense. I see a total of 125TB storage in /dashboard/admin/hypervisors/ while only having 24TB.