Agent assert in FlowStatsCollector::RequestHandler

[Hari Prasad Killi]

(gdb) bt
#0 0x00007ffba05f2cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007ffba05f60d8 in __GI_abort () at abort.c:89
#2 0x00007ffba05ebb86 in __assert_fail_base (
    fmt=0x7ffba073c830 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n",
    assertion=assertion@entry=0x11c8255 "0",
    file=file@entry=0x11f4128 "controller/src/vnsw/agent/vrouter/flow_stats/flow_stats_collector.cc",
    line=line@entry=804,
    function=function@entry=0x11f42e0 <FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>)::__PRETTY_FUNCTION__> "bool FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>)")
    at assert.c:92
#3 0x00007ffba05ebc32 in __GI___assert_fail (assertion=0x11c8255 "0",
    file=0x11f4128 "controller/src/vnsw/agent/vrouter/flow_stats/flow_stats_collector.cc", line=804,
    function=0x11f42e0 <FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>)::__PRETTY_FUNCTION__> "bool FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>)") at assert.c:101
#4 0x0000000000bb385e in FlowStatsCollector::RequestHandler (this=0x7ffb78000a80, req=...)
    at controller/src/vnsw/agent/vrouter/flow_stats/flow_stats_collector.cc:804

core file in mayamruga /data/bugs/<bug-id>

[Vinod Nair (vinodnair)]

Another core in 2712 kilo is at /cs-shared/bugs/1543411

Backtrace:
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/bin/contrail-vrouter-agent'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00007f2aee186cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.
Traceback (most recent call last):
  File "/usr/share/gdb/auto-load/usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.19-gdb.py", line 63, in <module>
    from libstdcxx.v6.printers import register_libstdcxx_printers
ImportError: No module named 'libstdcxx'
(gdb) bt
#0 0x00007f2aee186cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007f2aee18a0d8 in __GI_abort () at abort.c:89
#2 0x00007f2aee17fb86 in __assert_fail_base (fmt=0x7f2aee2d0830 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0x11cb6b5 "0",
    file=file@entry=0x11f75a8 "controller/src/vnsw/agent/vrouter/flow_stats/flow_stats_collector.cc", line=line@entry=804,
    function=function@entry=0x11f7760 "bool FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>)") at assert.c:92
#3 0x00007f2aee17fc32 in __GI___assert_fail (assertion=0x11cb6b5 "0", file=0x11f75a8 "controller/src/vnsw/agent/vrouter/flow_stats/flow_stats_collector.cc",
    line=804, function=0x11f7760 "bool FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>)") at assert.c:101
#4 0x0000000000bb627e in FlowStatsCollector::RequestHandler(boost::shared_ptr<FlowExportReq>) ()
#5 0x0000000000bb7cdc in boost::detail::function::function_obj_invoker1<boost::_bi::bind_t<bool, boost::_mfi::mf1<bool, FlowStatsCollector, boost::shared_ptr<FlowExportReq> >, boost::_bi::list2<boost::_bi::value<FlowStatsCollector*>, boost::arg<1> > >, bool, boost::shared_ptr<FlowExportReq> >::invoke(boost::detail::function::function_buffer&, boost::shared_ptr<FlowExportReq>) ()
#6 0x0000000000bbcd39 in QueueTaskRunner<boost::shared_ptr<FlowExportReq>, WorkQueue<boost::shared_ptr<FlowExportReq> > >::RunQueue() ()
#7 0x00000000011793ec in TaskImpl::execute() ()
#8 0x00007f2aeed55b3a in ?? () from /usr/lib/libtbb.so.2
#9 0x00007f2aeed51816 in ?? () from /usr/lib/libtbb.so.2
#10 0x00007f2aeed50f4b in ?? () from /usr/lib/libtbb.so.2
#11 0x00007f2aeed4d0ff in ?? () from /usr/lib/libtbb.so.2
#12 0x00007f2aeed4d2f9 in ?? () from /usr/lib/libtbb.so.2
#13 0x00007f2aeef71182 in start_thread (arg=0x7f2ae6c0a700) at pthread_create.c:312
#14 0x00007f2aee24a47d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
(gdb) :q

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/17228
Submitter: Ashok Singh (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/17228
Committed: http://github.org/Juniper/contrail-controller/commit/8248229ea05b180592c545fcce8362f8c854d00c
Submitter: Zuul
Branch: master

commit 8248229ea05b180592c545fcce8362f8c854d00c
Author: Ashok Singh <email address hidden>
Date: Sun Feb 14 22:55:06 2016 -0800

Ignore duplicate deletes in FlowStatsCollector module.

In some transient cases it is possible that two flows with same flow Key
exists in two different partitions. In this scenario, FlowStatsCollector module
can receive duplicate deletes. For now, the FlowStatsCollector module will ignore
duplicate deletes and this scenario will be handled later in FlowStatsCollector by
changing the key from FlowKey to FlowUUID.

Also print partition-id in Flow trace messages.

Change-Id: I79988347a2c7294215e63e950ef871e25a126b3c
Closes-Bug: #1543411