Comment 1 for bug 1580405

After speaking with Blake about this it appears that this was due to me raising a ValidationError. ValidationErrors are meant to be user errors(e.g an invalid option passed over the API) and are thus ignored. Changing the validation to use an assert shows the error.