Comment 3 for bug 718478

After making a change to propagate mirror failures (lp:724096), we, while made sure we build up-to-date and correct code, also started to be susceptible to flakiness of upstream 3rd party servers. And AOSP server flakiness increases every week :-(. Right now I cannot proceed with toolchain build work because I can't do a build for few hours. And Patrik Ryd reported similar issues end of last week, when he couldn't complete a source tree checkout of omapzoom repo with mirror service default of using 8 HTTP threads for repo sync.

So, this appears to be pressing issue which needs to be resolved out-of-band. The plan:

To settings.py add config var UPSTREAM_HOSTS which is a dictionary from host name to a dictionary of mirroring parameters. E.g.:

UPSTREAM_HOSTS = {
"android.git.kernel.org": {"stale": 60*60, "jobs": 6},
"git.omapzoom.org": {"stale": 30*60, "jobs": 1},
"git.linaro.org": {"stale": 1*60, "jobs": "8"}
"*": {"stale": 10*60, "jobs": "4"}
}

"stale" specifies period after which host's repo should be updated (if less than that passed since last update, no need to sync again), "jobs" - -j value.