importd running too many jobs

[Chris Jones]

The importds seem to be running multiple jobs in parallel, without (sufficient?) regard for the capabilities of the underlying hardware, which is leading to machines being driven into swap and degrading in performance significantly.

[Chris Jones (cmsj)]

(as an example, russkaya is currently running 6 jobs including a stable kernel tree and samba, and is far enough into swap as a result that I would not expect it to complete before the IO load brings it down)

[Michael Hudson-Doyle (mwhudson)]

The system is designed to run up to 10 jobs in parallel, which may have made sense for CVS and svn jobs that were much more network bound -- git imports seem mostly CPU bound and seem to use more RAM to boot.

This shouldn't be too hard to tweak to something more sensible.

[Tom Haddon (mthaddon)]

Would the tweaking be a case of simply reducing the number of parallel jobs it's designed to run, or could we have something that knows if it's struggling and adjusts accordingly?

[Michael Hudson-Doyle (mwhudson)]

bug 497645 was filed later but contains more details on how to approach fixing this, so marking as a dup of that bug.