manual provider cannot download tools

[Curtis Hovey]

Both the aws ams64 and the lexington ppc64 manual tests cannot bootstrap.
    http://juju-ci.vapour.ws:8080/job/manual-deploy-precise-amd64/1113/console
    http://juju-ci.vapour.ws:8080/job/manual-deploy-trusty-ppc64/615/console
The upgrade tests pass

Both failing tests show something like this:
jujud-machine-0 start/running, process 4765
Attempt 1 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 2 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 3 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 4 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 5 to download tools...
/bin/bash: line 27: aria2c: command not found
sha256sum: /var/lib/juju/tools/1.21-alpha1-trusty-ppc64el/tools.tar.gz: No such file or directory
Attempt 1 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 2 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 3 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 4 to download tools...
/bin/bash: line 27: aria2c: command not found
Download failed..... wait 15s
Attempt 5 to download tools...
/bin/bash: line 27: aria2c: command not found
sha256sum: /var/lib/juju/tools/1.21-alpha1-trusty-ppc64el/tools.tar.gz: No such file or directory
Bootstrap failed, destroying environment

[Curtis Hovey (sinzui)]

The failing commit is 8a61d29a56922a2afb601d353d44a3206791b236, BUT....
these tests have NOT passes in 4 days.

The last passing commit was a574921a, the first failing commit was a93e1df9. The suspect commits are
edd28ea Merge pull request #593 from dimitern/networker-takes-machinetag
560bf18 Merge pull request #597 from davecheney/state-fix-logf-in-tests
7f3fa38 Merge pull request #584 from katco-/lp-1322302-local-slow-transition-part-2
a93e1df Merge pull request #530 from ericsnowcurrently/backups-storage

HOWEVER, the failures from a few days ago are about mongodb, up until commit 0c6ec68, the errors were this.
2014-08-26 03:46:42 INFO juju.utils.apt apt.go:132 Running: [apt-get --option=Dpkg::Options::=--force-confold --option=Dpkg::options::=--force-unsafe-io --assume-yes --quiet install --target-release precise-updates/cloud-tools mongodb-server]
2014-08-26 03:46:52 ERROR juju.utils.apt apt.go:166 apt-get command failed: unexpected error type *errors.errorString
args: []string{"apt-get", "--option=Dpkg::Options::=--force-confold", "--option=Dpkg::options::=--force-unsafe-io", "--assume-yes", "--quiet", "install", "--target-release", "precise-updates/cloud-tools", "mongodb-server"}

2014-08-26 03:46:52 ERROR juju.cmd supercommand.go:323 cannot install mongod: apt-get failed: unexpected error type *errors.errorString

The first time we see the tools errors are with commit f8ff4561. Maybe the mongodb issue was fixed, or it mutated. Maybe the mongodb err is still present, but this new error prevents us from see it. The suspect commits are
f8ff456 Merge pull request #608 from axw/cloudinit-download-tools-apiserver

[Andrew Wilkins (axwalk)]

I guess the apt-get changes and my changes to use aria2c collided. We should be installing aria2c on bootstrap, but it would appear that is not happening.

[Andrew Wilkins (axwalk)]

I was able to trivially repro on trunk. Fixing now.