When env is deleted, Fuel must remove nodes from Cobbler even if nodes are not responding via RPC/ssh
Bug #1283825 reported by
Mike Scherbakov
This bug affects 2 people
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Released
|
High
|
Evgeniy L |
Bug Description
Env: Fuel ISO #180.
Not sure if it is the case, logs research is required. Still, it looks like that when I clicked on "remove env", and nodes were inaccessible by ssh & RPC, Fuel did not remove systems from Cobbler. So, when I turned on nodes, they started to boot from disk - as Cobbler system information forces them to do.
It becomes a real issue in production systems in case if node was offline during removal, as the only workaround is to go into Cobbler UI and manually remove systems.
Changed in fuel: | |
milestone: | 5.0 → 4.1 |
To post a comment you must log in.
This is very strange, because we always delete nodes from a cobbler when run reset/delete env tasks. Of course, only if Nailgun send a data about this nodes to the orchestrator, but he send as i can see.
Extracts from logs:
2014-02-23T20:31:27 debug: [10792] Cobbler initialize with username: cobbler, password: cobbler
2014-02-23T20:31:27 info: [10792] Removing system from cobbler: node-1
2014-02-23T20:31:27 info: [10792] System has been successfully removed from cobbler: node-1
2014-02-23T20:31:27 info: [10792] Removing system from cobbler: node-2
2014-02-23T20:31:27 info: [10792] System has been successfully removed from cobbler: node-2
2014-02-23T20:31:27 info: [10792] Removing system from cobbler: node-3
2014-02-23T20:31:27 info: [10792] System has been successfully removed from cobbler: node-3
2014-02-23T20:31:27 debug: [10792] Cobbler syncing
2014-02-23T20:35:45 warning: [10792] 08fae517- 5662-4834- 9c84-09d0c5c226 44: Removing of nodes ["1", "2", "3"] finished with errors. Nodes [{"uid"=>"1", "error"=>"Node not answered by RPC."}] are inaccessible 5662-4834- 9c84-09d0c5c226 44: Finished removing of nodes: ["1", "2", "3"]
2014-02-23T20:35:45 info: [10792] 08fae517-
Is node-1 or another node was still present in cobbler web ui after reset env tasks was finished?