Build 2714 : Agent crashed at MirrorKSyncObject::GetIdx in InterfaceKSyncEntry::AddMsg

[Ankit Jain]

#0 0x0000000000cc3ed7 in MirrorKSyncObject::GetIdx(std::string) ()
#1 0x0000000000cb9f83 in InterfaceKSyncEntry::Encode(sandesh_op::type, char*, int) ()
#2 0x0000000000cba8fd in InterfaceKSyncEntry::AddMsg(char*, int) ()
#3 0x0000000000ce7364 in KSyncNetlinkDBEntry::Change() ()
#4 0x0000000000d96c09 in KSyncSM_Change(KSyncObject, KSyncEntry) ()
#5 0x0000000000d97695 in KSyncObject::NotifyEvent(KSyncEntry*, KSyncEntry::KSyncEvent) ()
#6 0x0000000000d98bc1 in KSyncDBObject::Notify(DBTablePartBase, DBEntryBase) ()
#7 0x000000000106b5ba in DBTableBase::RunNotify(DBTablePartBase, DBEntryBase) ()
#8 0x000000000106dca8 in DBTablePartBase::RunNotify() ()
#9 0x0000000001069e8d in DBPartition::QueueRunner::Run() ()
#10 0x000000000117abcc in TaskImpl::execute() ()
#11 0x00007f13ff72db3a in ?? () from /usr/lib/libtbb.so.2
#12 0x00007f13ff729816 in ?? () from /usr/lib/libtbb.so.2
#13 0x00007f13ff728f4b in ?? () from /usr/lib/libtbb.so.2
#14 0x00007f13ff7250ff in ?? () from /usr/lib/libtbb.so.2
#15 0x00007f13ff7252f9 in ?? () from /usr/lib/libtbb.so.2
#16 0x00007f13ff949182 in start_thread (arg=0x7f13f71e1700) at pthread_create.c:312
#17 0x00007f13fec2247d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

bug 1542009 was fixed for the crash happening in InterfaceKSyncEntry::DeleteMsg
Now, agent is again crashing nterfaceKSyncEntry::AddMsg Please fix this

Steps

admin nodeh3 left_vm ubuntu 1.1.1.249 m1.small Active None Running 1 hour, 22 minutes
admin nodeh3 contrail_svm analyzer 1.1.1.250 1.1.1.252 m1.medium Active None Running 1 hour, 23 minutes
admin nodeh3 right_vm ubuntu 1.1.1.251

1)Port mirroring enabled on left vm

2) Two more VMs (as shown below) both on different CNs, starting ping 10.1.1.4 from 10.1.1.6 , restart ing vrouter on nodeh3 is causing vrouter to crash every time

admin nodea21 vm-4ubuntu 10.1.1.4 m1.small Active

admin nodeh3 vm-3 ubuntu 10.1.1.6 m1.small Active

cores copied @ /cs-shared/bugs/<bug-id> on any blr shell server (ex nodeb6)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17742
Submitter: jayaramsatya (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17742
Committed: http://github.org/Juniper/contrail-controller/commit/47f0fa5b9a60d62d1e2b990904b7693917afa10d
Submitter: Zuul
Branch: R3.0

commit 47f0fa5b9a60d62d1e2b990904b7693917afa10d
Author: jayaramsatya <email address hidden>
Date: Wed Feb 24 16:19:53 2016 +0530

when ever interface object is getting created which has analyzer attached to it
then interface entry depends on mirror entry to present.
if the mirror entry is not resolved we are adding mirror entry in temp state.
closes-bug: #1547531

Change-Id: I34a56df5cf957e5be00976e7f9978b1414c19033

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/18107
Submitter: Praveen K V (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/18107
Committed: http://github.org/Juniper/contrail-controller/commit/5243c867c642e928dcda17071b89e2bd6b13818b
Submitter: Zuul
Branch: master

commit 5243c867c642e928dcda17071b89e2bd6b13818b
Author: jayaramsatya <email address hidden>
Date: Wed Feb 24 16:19:53 2016 +0530

when ever interface object is getting created which has analyzer attached to it
then interface entry depends on mirror entry to present.
if the mirror entry is not resolved we are adding mirror entry in temp state.
(cherry picked from commit 819f94e7407fecdc2de390e0cfa64465c711923e)

closes-bug: #1547531
Change-Id: I34a56df5cf957e5be00976e7f9978b1414c19033