If nova-manage service list shows with XXX for controller that we remove - it is related to the mos(some times ago we post such issues) , so please, add output of command nova-manage service list from controller and id of removed controller
If nova-manage service list shows with XXX for controller that we remove - it is related to the mos(some times ago we post such issues) , so please, add output of command nova-manage service list from controller and id of removed controller