Due to bug https://bugs.launchpad.net/fuel/+bug/1290874 (where UI is not updated, therefore the nodes remain in provisioning state) it is possible to discard a node and pursue with the deployment process without that node (see screenshots attached). After deployment HA works fine, the deleted node has OpenStack installed and is visible in cobbler, just not visible on UI. But when deleting the cluster this node is not bootstrapped.
I think, we need to add some checks to the backend that verify all requests from the UI to avoid such issues. Now this issue is caused by the bug on the UI, but who knows what can happen in the future.
Reproduces on:
{"build_id": "2014-03-17_03-01-16", "mirantis": "yes", "build_number": "32", "nailgun_sha": "2ace3ab436fef250e414ba3fa577198f7de4a92e", "ostf_sha": "0ad6f6de46e615022c2672c345a11fb44ffaa4e1", "fuelmain_sha": "7acc547eb531d4a15b5d3361a2ea308a4ea4ced2", "astute_sha": "a80acd1312be70676f0dd936814b27ce01fb013d", "release": "5.0", "fuellib_sha": "0f2765736a2e4af7265eeb936161f0a90cdc9a2e"}
Steps to reproduce (KVM):
1. Create HA cluster with 3 controllers and 1 compute.
2. Remember the MAC-address of one of the controllers.
3. Click "Deploy Changes".
4. Due to https://bugs.launchpad.net/fuel/+bug/1290874 it remains possible to remove one of the nodes, so remove the controller.
- the page will be updated and there will be provisioning of HA cluster with 2 controllers (see screenshots)
5. Wait until cluster is deployed, check if the node is visible by cobbler, ssh to it, run OSTF for HA.
- there will be no errors, the nodes will become ready, HA OSTF tests will pass, because on the backend the node still remains in the cluster.
6. Delete cluster.
7. Create new cluster.
8. Go to the "Assign Roles" tab.
Expected result:
The node that was deleted from HA cluster is in bootstrapped state.
Actual result:
The node that was deleted is in ready state, if performing ssh to it, it can be seen that OS is still installed.
Basically the problem lies in that we have to decide which nodes to bootstrap not according to the information from UI, but to handle it some other way.