vRouter taking 98% memory after CN failure

Bug #1551503 reported by amit surana
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
Fix Committed
High
Manish Singh
Trunk
Fix Committed
High
Manish Singh

Bug Description

3.0 2722.

Setup had 30 BGPaaS VMs all of which were connected to 2 of the 3 CNs in the cluster. One of the control-node was then stopped (service contrail-control stop). After doing this, the vRouter memory utilization started to steadily increase and eventually hit 98%.

contrail-logs were collected for the duration over which memory utilization started to spike.

amit surana (asurana-t)
tags: added: releasenote
Revision history for this message
Praveen (praveen-karadakal) wrote :

Function void BgpAsAServiceFlowMgmtTree::DeleteAll() goes into infinite loop and allocating BgpAsAServiceFlowMgmtRequest event in every iteration.

Revision history for this message
amit surana (asurana-t) wrote :

Release-note:

In multi-controller clusters, if there is a control node failure, the memory utilization of the vRouter Agent, running on the compute that has the BGPaaS VM, can grow unchecked, with Agent eventually holding 100% of the memory. If this bug is hit, restart vRouter agent to workaround.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.0

Review in progress for https://review.opencontrail.org/18293
Submitter: Manish Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/18293
Committed: http://github.org/Juniper/contrail-controller/commit/2439dc0374eb87b8220d62ba56bbef7ea2cdacc3
Submitter: Zuul
Branch: R3.0

commit 2439dc0374eb87b8220d62ba56bbef7ea2cdacc3
Author: Manish <email address hidden>
Date: Wed Mar 9 16:58:22 2016 +0530

Increment iterator.

Change-Id: I11967402abbd27fd506829426dbaca59930c034a
Closes-bug: 1551503

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/18438
Submitter: Manish Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/18438
Committed: http://github.org/Juniper/contrail-controller/commit/16281081637a6982ff840f318bde25d9955f5aad
Submitter: Zuul
Branch: master

commit 16281081637a6982ff840f318bde25d9955f5aad
Author: Manish <email address hidden>
Date: Wed Mar 9 16:58:22 2016 +0530

Increment iterator.

Change-Id: I11967402abbd27fd506829426dbaca59930c034a
Closes-bug: 1551503

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.