Comment 2 for bug 1331092

So it turns out that we elevate context on the compute manager side as well. The above fix will raise an exception during validate, but we also should prevent the wrong networks from being returned during allocate as well. This fix adds the secondary safety fix as well.