Network checker failed by timeout on cluster with 105 slaves

[Tatyanka]

{"build_id": "2014-10-09_00-01-06", "ostf_sha": "2ef0b8700460da0a46af7b7963bddaf59e1d7518", "build_number": "5", "auth_required": true, "api": "1.0", "nailgun_sha": "86015d2e0fe77d7f48675742fa3cde34714bea32", "production": "docker", "fuelmain_sha": "d7575e0cba75f04a8213146a54025a45219850f9", "astute_sha": "65a5a0781d314bdcc090a61a599a8abf95989fc1", "feature_groups": ["mirantis"], "release": "6.0", "release_versions": {"2014.2-6.0": {"VERSION": {"build_id": "2014-10-09_00-01-06", "ostf_sha": "2ef0b8700460da0a46af7b7963bddaf59e1d7518", "build_number": "5", "api": "1.0", "nailgun_sha": "86015d2e0fe77d7f48675742fa3cde34714bea32", "production": "docker", "fuelmain_sha": "d7575e0cba75f04a8213146a54025a45219850f9", "astute_sha": "65a5a0781d314bdcc090a61a599a8abf95989fc1", "feature_groups": ["mirantis"], "release": "6.0", "fuellib_sha": "e46e4325ea2b676e3bd3d115d87dfefd1fe4d95a"}}}, "fuellib_sha": "e46e4325ea2b676e3bd3d115d87dfefd1fe4d95a"}

Steps to Reproduce:
1. Deploy ubuntu with 3 controller, 82 computes, 5 cinder nodes with neutron GRE
2. Configure nettworks like:
admin net on eth0
others on eth1 with tagging
3. Run net verification

Actual result:
Current timeout is not enaugh to check all the slaves. But it is enought for 57 slaves

http://paste.openstack.org/show/119840/

[Łukasz Oleś (loles)]

/var/log/docker-logs/astute dir is missing. Can you attach the content of it?

[Dima Shulyak (dshulyak)]

I'm pretty sure it is timed out on get_probing_info call due to huge amount of traffic to parse.

[Artem Panchenko (apanchenko-8)]

Attached Astute's logs.