[Heat] Cinder volumes are not removed when using Heat

[Yaroslav Lobankov]

Reproduction steps:

1. Create cluster with attached volumes to cluster nodes.
2. Wait for "Active" cluster state.
3. Delete cluster.

EXPECTED RESULT:
Cluster nodes are deleted, volumes are deleted.

ACTUAL RESULT:
Any node cannot be removed. Some volumes have "in use" state but they are not attached to cluster nodes. Some volumes have "available" state and can be removed. The only way to remove volumes is to manually reset their state to "available" via cinder's CLI. After volume's state resetting Heat can successfully finish stack deletion.

This bug is reproduced practically always. It depends on speed of environment. The more nodes cluster has the more likely you will encounter it.

[Alexander Ignatov (aignatov)]

Filed a bug in Heat https://bugs.launchpad.net/heat/+bug/1298350
This bug in Sahara should be revisited once bug in Heat is fixed.

[Alexander Ignatov (aignatov)]

Bug in heat https://bugs.launchpad.net/heat/+bug/1298350 is fixed. The state of current bug should be revised.
Also I found that cinder volume detachment in Heat was affect by fix of https://bugs.launchpad.net/heat/+bug/1311533 .

[Andrew Lazarev (alazarev)]

We don't have environment with new heat yet.

[Sergey Reshetnyak (sreshetniak)]

Not reproduced with Heat from master because bug 1298350 is fixed.

[Alexander Ignatov (aignatov)]

I'd prefer to close this bug only after heat job in integration tests passes tens of times

[Sergey Reshetnyak (sreshetniak)]

Heat job in integration tests passes ~3 weeks. I closes this bug.