stats inconsistent

[Kevin Fox]

We were removing a project from our cloud. we deleted all the vm's, and deleted all the volumes/snapshots. Then we noticed in Horizion's overview page that there are still two volumes in existence and claiming to use space. But the volumes don't show up in the volumes list nor snapshots. We have no cinder backup setup either.

What would cause this inconsistency? This is a newton cloud currently. We want to upgrade to the next version soon but are reluctant to do so if there is database issues.

Thanks,
Kevin

[Kevin Fox (kevpn)]

Some more info:
One of our admins reports:

I looked in the cinder database. There are 7 rows in the cinder.volumes table. They all show deleted.

With those volume_ids – there are :

11 records in the volume_admin_metadata (all deleted)

0 records in volume_metadata

5 records in volume_attachment. (all deleted)

[Gorka Eguileor (gorka)]

You shouldn't need to check the DB manually since the REST API will give you the same data.

I don't know if horizon is caching some data, so the best way to do it is checking directly with the Cinder client.

If you do a cinder list and the 2 volumes are not there, or is you do a "cinder show" and you get an error that the volume don't exist, then as far as Cinder is concerned they are not there. To be extra sure you could go to the storage array's management tool and check if the volumes are there.

You can also check the stats with "cinder get-pools --detail" to see what's actually been used.

[Kevin Fox (kevpn)]

Where could horizon be getting cached data? It doesn't have a storage mechanism of its own at all. it asks cinder's api for things. This is a bug in cinder?

[Sean McGinnis (sean-mcginnis)]

Were you able to run the cinder commands at least to compare the output Kevin? We might have to get some help from the Horizon team if it does in fact show a difference between the two.