There should be a way to force an update of an entire bug tracker

[Graham Binns]

At the moment the only way we can update an entire bug tracker is to manually reset all its BugWatches' lastchecked times to NULL before running `cronscripts/checkwatches -vvt $bugtracker -b0`, which will update all the watches on the tracker in one go.

The trouble with this approach is that it doesn't scale to bug trackers with large numbers of watches, like the Gnome Bugzilla, which at the moment has > 13,000 watches against it. If we were to try to update all 13,000 watches at once it is almost certain that we'd either overload the remote server or that the process would take so long as to make our connection time out.

What we should be able to do is something like this:

$ cronscripts/checkwatches.py -vv -t $bugtracker -b 500 --all

This would update all bug watches for $bugtracker in batches of 500, looping until done. This has the advantage of reusing the existing BugWatchUpdater to do all the heavy lifting (though it may make more sense to write an extra script for this, since its torturous enough working with checkwatches' logic already).

[Jonathan Lange (jml)]

FWIW, forcing updates & forcing full updates should be a general consideration for any "import" style jobs.

[Jonathan Lange (jml)]

Not saying that you've missed it, but more of a note to self that we should have some sort of body-of-knowledge / API / thing.

[Graham Binns (gmb)]

2009/9/30 Jonathan Lange <email address hidden>:
> FWIW, forcing updates & forcing full updates should be a general
> consideration for any "import" style jobs.

Right. Also, let it be noted that bug 416881 says that I really want
to rewrite checkwatches in the style of the code import daemon /
thing. This is mostly a stop-gap to make sure that the Distro team get
their bug watches updated.

--
Graham Binns | PGP Key: EC66FA7D

[Diogo Matsubara (matsubara)]

Fixed in devel r9638 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/revision/9638>

[Graham Binns (gmb)]

This was released back in October.