Comment 13 for bug 982938

Revision history for this message
Michael Nelson (michael.nelson) wrote : Re: [Bug 982938] Re: generate-ppa-htaccess takes several minutes to run

On Thu, May 31, 2012 at 1:01 AM, Robert Collins
<email address hidden> wrote:
> DBM is roughly equivalent to querying in realtime (in that we wouldn't
> need an a-priori listing of all users), but harder (because we would
> need a message passing system to keep it up to date). We can just query
> a fast webservice, I suspect, with a small cache. We've done this
> before.
>
> @noodles Loading all the PPA tokens into memory isn't an issue, because
> a single run only ever updates a few minutes worth of PPAs. That said,
> having N queries per archive is fine, so your branch isn't a problem
> (even though it increases query count).
>

Cool - thanks Robert. We weren't sure whether loading 21k tokens into
memory (for one PPA) would be an issue until the data collection
branch was finished, and so decided to push the branch forward without
knowing for sure. Glad it's sorted now.