What about adding a redundant button to remove/reset color next to add a color? It will cost us a few pixels on screen but it'll solve the problem.
What about adding a redundant button to remove/reset color next to add a color? It will cost us a few pixels on screen but it'll solve the problem.