agent: Very high mem usage by agent

[Senthilnathan Murugappan]

Observed that the agent was utilizing almost 124G and eventually it crashed and the crash file is at /var/crashes/core.contrail-vroute.30080.a2s42.1452820512 of 10.84.7.42
The op leading up to it was to delete a LBaas VIP. Even after the vip is deleted I do observe agent utilizing 88G RAM after coredump restart. The setup is in the state.
(I doubt vip is the issue since the crash seems similar to #1534348 where in there wasn’t any mem leak or so)
FYI, have been testing service-health-check with LBaas with multiple create and delete over time.

The unstripped binary is at /root/contrail-vrouter-agent

Build info: 3.0-2696-kilo-ubuntu1404

[Manish Singh (manishs)]

Hari had tried valgrind but nothing was seen second time. So waiting for it to happen next time.

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/16518
Submitter: Hari Prasad Killi (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/16518
Committed: http://github.org/Juniper/contrail-controller/commit/2777dd2a30c95d90fc28c76f74ef70f44de41788
Submitter: Zuul
Branch: master

commit 2777dd2a30c95d90fc28c76f74ef70f44de41788
Author: Hari <email address hidden>
Date: Tue Jan 26 20:39:32 2016 +0530

Initialize all fields in Agent

send_ratelimit_ uninitialized is resulting in large memory allocation
at init.

closes-bug: 1534831
Change-Id: I267e3ecd7d21151098c118d8bbd83643f69f6b50

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/20958
Submitter: Hari Prasad Killi (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/20959
Submitter: Hari Prasad Killi (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/20960
Submitter: Hari Prasad Killi (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/20959
Committed: http://github.org/Juniper/contrail-controller/commit/646dddb9c73cb82f10891747d0421dd136785fdb
Submitter: Zuul
Branch: R2.20

commit 646dddb9c73cb82f10891747d0421dd136785fdb
Author: Hari <email address hidden>
Date: Mon Jun 6 15:57:19 2016 +0530

Initialise agent parameter.

Change-Id: I9b2866627432f9f94881e0e856e8694b3f4a16bf
closes-bug: #1534831
(cherry picked from commit f5a1395c96acc677b903b180ccd8256482ad9636)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/20958
Committed: http://github.org/Juniper/contrail-controller/commit/f5a1395c96acc677b903b180ccd8256482ad9636
Submitter: Zuul
Branch: R2.22.x

commit f5a1395c96acc677b903b180ccd8256482ad9636
Author: Hari <email address hidden>
Date: Mon Jun 6 15:57:19 2016 +0530

Initialise agent parameter.

Change-Id: I9b2866627432f9f94881e0e856e8694b3f4a16bf
closes-bug: #1534831

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/20960
Committed: http://github.org/Juniper/contrail-controller/commit/f19758e896853d138a448ffa2f5ff4d0d53f58c0
Submitter: Zuul
Branch: R2.21.x

commit f19758e896853d138a448ffa2f5ff4d0d53f58c0
Author: Hari <email address hidden>
Date: Mon Jun 6 15:57:19 2016 +0530

Initialise agent parameter.

Change-Id: I9b2866627432f9f94881e0e856e8694b3f4a16bf
closes-bug: #1534831
(cherry picked from commit f5a1395c96acc677b903b180ccd8256482ad9636)