Comment 2 for bug 876447

I think it would be nice allowing scrolling down and then right without raising the fingers, and only preventing when scrolling diagonally or when the sideway move is much shorter than the original scroll (aka, a wobble).
But if it is too hard to implement, simply disallowing a scroll in another direction like you suggest would be a good start.