Comment 4 for bug 128394

I thought Edward had coded the algorithms and that we had done significant de-duping in the current catalog, but that there was more to do. I'd like to help with this if I can. As Alexis says, it is a big messy task, but the methods involve are also of interest for the search stuff I'm doing.

We had a meeting quite a long time back where we discussed this in detail and I thought I understood it then, so maybe I'm way behind the times now.