Comment 1 for bug 1183507

We only use such classes through shared_ptrs, which, even when upcasted, "remember" the derived class type and call the proper destructor.

Of course, that's not to say that we shouldn't fix the missing virtual destructors (we should!), just that they are not a super critical issue in our case.