DPDK: Agent crash in nl_update_header

[Vinod Nair]

On Provision a cluster with DPDK using build 3.0-2659~juno, Vrouter-agent keeps crashing
The back trace is as below

Core was generated by `/usr/bin/contrail-vrouter-agent'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 nl_update_header (cl=0x7f2d980fe7f0, data_len=458) at vrouter/utils/nl_util.c:253
253 vrouter/utils/nl_util.c: No such file or directory.
(gdb) bt
#0 nl_update_header (cl=0x7f2d980fe7f0, data_len=458) at vrouter/utils/nl_util.c:253
#1 0x0000000000c27df5 in UpdateNetlink (seq_no=0, len=458, client=0x7f2d980fe7f0) at controller/src/ksync/ksync_sock.cc:137
#2 KSyncSockTcp::SendTo (this=0x7f2d980fe070, data=0x7f2d9ca2bb10 "", data_len=458, seq_no=0) at controller/src/ksync/ksync_sock.cc:642
#3 0x0000000000bfb366 in KSync::VRouterInterfaceSnapshot (this=this@entry=0x7f2d98006000)
    at controller/src/vnsw/agent/vrouter/ksync/ksync_init.cc:124
#4 0x0000000000bfbc41 in KSyncTcp::Init (this=0x7f2d98006000, create_vhost=<optimized out>)
    at controller/src/vnsw/agent/vrouter/ksync/ksync_init.cc:314
#5 0x0000000000a50dd1 in AgentInit::InitBase (this=0x7fff11187300) at controller/src/vnsw/agent/init/agent_init.cc:128
#6 0x0000000001097b3f in operator() (this=<optimized out>) at /usr/include/boost/function/function_template.hpp:767
#7 TaskTrigger::WorkerTask::Run (this=0x303fd10) at controller/src/base/task_trigger.cc:19
#8 0x0000000001094950 in TaskImpl::execute (this=0x7f2d9cc07d40) at controller/src/base/task.cc:238
#9 0x00007f2da3f75b3a in ?? () from /usr/lib/libtbb.so.2
#10 0x00007f2da3f71816 in ?? () from /usr/lib/libtbb.so.2
#11 0x00007f2da3f70f4b in ?? () from /usr/lib/libtbb.so.2
#12 0x00007f2da3f6d0ff in ?? () from /usr/lib/libtbb.so.2
#13 0x00007f2da3f6d2f9 in ?? () from /usr/lib/libtbb.so.2
#14 0x00007f2da4191182 in start_thread (arg=0x7f2d9ca2d700) at pthread_create.c:312
#15 0x00007f2da346a47d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Corefile can be downloaded from below

http://cmbu-sv02.englab.juniper.net/pxe/Standard/vin/dpdk/core14/

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/14630
Submitter: Naveen N (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/14630
Committed: http://github.org/Juniper/contrail-controller/commit/2e29ce73ecb467aa3a53204dea4255cdea2a0acc
Submitter: Zuul
Branch: master

commit 2e29ce73ecb467aa3a53204dea4255cdea2a0acc
Author: naveenn <email address hidden>
Date: Sat Oct 24 15:34:34 2015 +0530

* Initialize nl_client for KSync TCP socket session.
Closes-Bug:#1507071

Change-Id: I5541e16756f6c92c800392b953192349f9455dc3

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/14720
Submitter: Naveen N (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/14720
Committed: http://github.org/Juniper/contrail-controller/commit/381624ff8e460d97c4644af6837ce2c20c2b0dea
Submitter: Zuul
Branch: master

commit 381624ff8e460d97c4644af6837ce2c20c2b0dea
Author: naveenn <email address hidden>
Date: Fri Oct 30 10:34:38 2015 +0530

* Correct message length of the TCP vrouter sandesh message

sandesh message lenght was set to twice the size of
sandesh request, correcting the same.
Closes-bug:#1507071

Change-Id: I37a8c3b9cc32d4ba30a99fe3a2dcb8e99ca3abf6

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/15421
Submitter: Naveen N (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/15421
Committed: http://github.org/Juniper/contrail-controller/commit/4f23431a349a259a057c43bad0d6c399a4e956d0
Submitter: Zuul
Branch: master

commit 4f23431a349a259a057c43bad0d6c399a4e956d0
Author: naveenn <email address hidden>
Date: Wed Nov 25 14:14:45 2015 +0530

* Initialize netlink family ID after TCP socket creation
Closes-bug:#1507071

Change-Id: Iac6dd17171053453ebf51136c72c2aa20a2053a7