Comment 6 for bug 699150

I'm not sure there is a lot we can do about this.

When the mouse is over the button, the button gets the "prelight" state. That coincidentally looks just like the popped out button, and we don't seem to be setting the background correctly for that button state.

It should be possible to override the GTK style for the background colour of the prelight state.