[R3.1-build-33]: IPv6- ECMP routes are not created for ipv6 sometimes, agent restart fixes the issue

[alok kumar]

Sometime we hit the issue, where ECMP routes are not created if same static routes are added on 2 VMIs on different computes.

This issue is not always seen, and when in problematic state, restarting the agent recovers from the issue.

currently I'm hitting it in my setup:

look for static route prefix 9::/64.
http://nodec62.englab.juniper.net:8085/Snh_Inet6UcRouteReq?x=1
http://nodec12.englab.juniper.net:8085/Snh_Inet6UcRouteReq?x=1

horizon: http://nodec64.englab.juniper.net/horizon/admin/instances/
contrail UI: https://nodec64.englab.juniper.net:8143/#p=config_net_ports

steps:
-create 2 VMs on diff computes with dual stack.
-create a static route table with v6 prefix(9::/64) and add it on both VMIs
- ECMP routes should be created for 9::/64

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/25278
Submitter: Ashok Singh (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/25279
Submitter: Ashok Singh (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/25279
Committed: http://github.org/Juniper/contrail-controller/commit/668ee66a4a165cbe39ad484ab020f61fe925a023
Submitter: Zuul
Branch: R3.0.3.x

commit 668ee66a4a165cbe39ad484ab020f61fe925a023
Author: ashoksingh <email address hidden>
Date: Tue Oct 25 14:12:27 2016 +0530

Increase ARP and ND retries up to 5 minutes

Whenever the VM is spawned Agent sends ARP request for v4 and ND request for v6.
Increase the retries for these requests up to 5 minutes, with each retry after every 2 seconds.

Closes-Bug: #1625019
(cherry picked from commit abed3cd2b600d34bc92ebccefb247780b51e056b)

Change-Id: Ic84318eac76c573a8230a54b4091190a4189b152

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/25278
Committed: http://github.org/Juniper/contrail-controller/commit/abed3cd2b600d34bc92ebccefb247780b51e056b
Submitter: Zuul
Branch: master

commit abed3cd2b600d34bc92ebccefb247780b51e056b
Author: ashoksingh <email address hidden>
Date: Tue Oct 25 14:12:27 2016 +0530

Increase ARP and ND retries up to 5 minutes

Whenever the VM is spawned Agent sends ARP request for v4 and ND request for v6.
Increase the retries for these requests up to 5 minutes, with each retry after every 2 seconds.

Change-Id: Ie44c2870a7960b5a70c889b976f5e707aba72b98
Closes-Bug: #1625019

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/25302
Submitter: Ashok Singh (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/25303
Submitter: Ashok Singh (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/25304
Submitter: Ashok Singh (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/25303
Committed: http://github.org/Juniper/contrail-controller/commit/9b13da78a0990624e5d984fa4bbfbd28cb497d81
Submitter: Zuul
Branch: R3.1

commit 9b13da78a0990624e5d984fa4bbfbd28cb497d81
Author: ashoksingh <email address hidden>
Date: Tue Oct 25 14:12:27 2016 +0530

Increase ARP and ND retries up to 5 minutes

Whenever the VM is spawned Agent sends ARP request for v4 and ND request for v6.
Increase the retries for these requests up to 5 minutes, with each retry after every 2 seconds.

Closes-Bug: #1625019
(cherry picked from commit abed3cd2b600d34bc92ebccefb247780b51e056b)

Change-Id: I6074ad8d5affbc50bbb9fef9193773eb6198492e

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/25304
Committed: http://github.org/Juniper/contrail-controller/commit/dd02b8ee18e06a5fbcc2516854b656bd6a6cd018
Submitter: Zuul
Branch: R3.2

commit dd02b8ee18e06a5fbcc2516854b656bd6a6cd018
Author: ashoksingh <email address hidden>
Date: Tue Oct 25 14:12:27 2016 +0530

Increase ARP and ND retries up to 5 minutes

Whenever the VM is spawned Agent sends ARP request for v4 and ND request for v6.
Increase the retries for these requests up to 5 minutes, with each retry after every 2 seconds.

Closes-Bug: #1625019
(cherry picked from commit abed3cd2b600d34bc92ebccefb247780b51e056b)

Change-Id: Iaa5c4f8a4fe2ae2969e1356fa5b00acbcf033301

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/25302
Committed: http://github.org/Juniper/contrail-controller/commit/e7d0aa881f83356ae62f14ee072722cc2718b1fe
Submitter: Zuul
Branch: R3.0

commit e7d0aa881f83356ae62f14ee072722cc2718b1fe
Author: ashoksingh <email address hidden>
Date: Tue Oct 25 14:12:27 2016 +0530

Increase ARP and ND retries up to 5 minutes

Whenever the VM is spawned Agent sends ARP request for v4 and ND request for v6.
Increase the retries for these requests up to 5 minutes, with each retry after every 2 seconds.

Closes-Bug: #1625019
(cherry picked from commit abed3cd2b600d34bc92ebccefb247780b51e056b)

Change-Id: I958428279eb0665639a6e59652e597e77f7e5299