repo init failing for restricted builds

[vishal]

repo init is failing on restricted builds:
https://android-build.linaro.org/jenkins/job/linaro-android-restricted_vexpress-linaro-iks-mpconfig/26/console
https://android-build.linaro.org/jenkins/job/linaro-android-restricted_juice-aosp/146/console
https://android-build.linaro.org/jenkins/job/linaro-android-restricted_juice-aosp/147/console

Here is the error log:
+ repo init --quiet -u ssh://<email address hidden>/srv/linaro-private.git.linaro.org/android/manifest.git -b linaro_android_4.2.2 -m vexpress-juice-aosp.xml --repo-url=git://android.git.linaro.org/tools/repo.git --reference=/mnt/jenkins/workspace/linaro-android-restricted_juice-aosp/build/uniseed -g all,-notdefault,-eclipse

gpg: keyring `/home/jenkins-build/.repoconfig/gnupg/secring.gpg' created
gpg: keyring `/home/jenkins-build/.repoconfig/gnupg/pubring.gpg' created

gpg: /home/jenkins-build/.repoconfig/gnupg/trustdb.gpg: trustdb created
gpg: key 920F5C65: public key "Repo Maintainer <email address hidden>" imported

gpg: key 338871A4: public key "Conley Owens <email address hidden>" imported
gpg: Total number processed: 2

gpg: imported: 2 (RSA: 1)
fatal: repo init failed; run without --quiet to see why

++ infrastructure_error
++ echo 'Caught infrastructure error - finishing build with '\''Not Built'\'' status'

Caught infrastructure error - finishing build with 'Not Built' status
++ exit 123

The build 148 seem to have moved ahead with repo init after adding REPO_QUIET=false:
https://android-build.linaro.org/jenkins/job/linaro-android-restricted_juice-aosp/148/console

[Данило Шеган (danilo)]

git processes are using all the memory on the android.git.linaro.org so it likely fails in trying to fetch repo itself from git://android.git.linaro.org/tools/repo.git -- try switching that URL to http://android.git.linaro.org/git-ro/tools/repo.git in the "repo init" line.

We're working on providing the same scalable setup for private repositories as well. However, if it fails on them right now, there's not really a lot we can do other than suggest waiting for traffic to go down on git.linaro.org and then try again. We can also kill off git protocol access to git.linaro.org, but that'd be pretty unpopular measure if done all of a sudden.

[Axel Fagerstedt (fagerstedt-axel)]

Confirmed that it is the repo fetch from git://android.git.linaro.org/tools/repo.git which is failing.

+ repo init -u git://git.linaro.org/people/axelfagerstedt/manifests_sandbox.git -b refactor-2 -m tracking.xml --repo-url=git://android.git.linaro.org/tools/repo.git --reference=/mnt/jenkins/workspace/linaro-android-restricted_test-iks-manifest-consolidation/build/uniseed -g common,vexpress,vexpress-tests
Get git://android.git.linaro.org/tools/repo.git
fatal: read error: Connection reset by peer

[Axel Fagerstedt (fagerstedt-axel)]

Changing the url used in --repo-url would most likely require patching linaro-android-build-tools

Its currently set like:
./build-scripts/helpers:REPO_MIRROR="--repo-url=git://android.git.linaro.org/tools/repo.git"

[Axel Fagerstedt (fagerstedt-axel)]

It might be best to move it to setup-repo-vars and allow it to be overridden from the build config so we don't end up setting it to http indefinitely.

[Данило Шеган (danilo)]

For now, I've hard-coded it to http: there's nothing wrong with it being set to http indefinitely (fwiw, we want to move everything to http anyway). We might look into allowing it to be overridden when a need arises.

[Paul Sokolovsky (pfalcon)]

Just a comment - there's no need to override --repo-url= from build config, it's static and internal thing. We override it at all to not depend on AOSP tree's ups and downs (to remind, there were times, when AOSP wasn't available for almost 2 months in rows (great kernel.org blackout)).