scanner can be crippled by someone wanting diffs of changes from a large tree

[Michael Hudson-Doyle]

If someone subscribes to a large-treed branch -- say a MySQL branch -- on launchpad and wants to see diffs, this slows the scanner down tremendously -- hard to quantify how much, but it's a lot.

Not sure what to do about this, really.

[Jonathan Lange (jml)]

Some things we can do:
- Parallelize the scanner
- Generate diffs asynchronously
- Generate diffs elsewhere and elsewhen.

I think we have a relatively clear idea about where we want to go. I suggest that you talk with thumper (there may be hardware dependencies) and then thrash out a spec / series of smaller bugs.

[Tom Haddon (mthaddon)]

Is this a one-time problem when someone first subscribes, or a continual issue for as long as they're subscribed?

[Michael Hudson-Doyle (mwhudson)]

It's a continual issue.

[Michael Hudson-Doyle (mwhudson)]

I think Aaron's work is solving this.

[Jonathan Lange (jml)]

Is this done?

[Aaron Bentley (abentley)]

No. I'm QAing it today.

[Aaron Bentley (abentley)]

My bad, that's the other diff thing that is now landed.