R3.0.2-kilo-agent crash in vcenter- Vrouter vm@LifetimeManager::DeleteExecutor(LifetimeManager::LifetimeActorRef)

Bug #1580733 reported by shajuvk
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
Fix Committed
High
Naveen N
Trunk
Fix Committed
High
Naveen N

Bug Description

sing host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/bin/contrail-vrouter-agent'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x0000000000000000 in ?? ()
(gdb) bt
#0 0x0000000000000000 in ?? ()
#1 0x0000000000c2b65a in FlowMgmtTree::LowerBound(FlowMgmtKey*) ()
#2 0x0000000000c2c84a in ?? ()
#3 0x0000000000c2c8a7 in FlowMgmtManager::HasVrfFlows(unsigned int) ()
#4 0x0000000000c2c93a in VrfFlowMgmtEntry::CanDelete() const ()
#5 0x0000000000c389a3 in LifetimeRef<VrfFlowMgmtEntry::Data>::Delete() ()
#6 0x00000000011973e2 in LifetimeManager::DeleteExecutor(LifetimeManager::LifetimeActorRef) ()
#7 0x00000000011977c0 in boost::detail::function::function_obj_invoker1<boost::_bi::bind_t<bool, boost::_mfi::mf1<bool, LifetimeManager, LifetimeManager::LifetimeActorRef>, boost::_bi::list2<boost::_bi::value<LifetimeManager*>, boost::arg<1> > >, bool, LifetimeManager::LifetimeActorRef>::invoke(boost::detail::function::function_buffer&, LifetimeManager::LifetimeActorRef) ()
#8 0x0000000001199b2f in QueueTaskRunner<LifetimeManager::LifetimeActorRef, WorkQueue<LifetimeManager::LifetimeActorRef> >::Run() ()
#9 0x00000000011a848f in TaskImpl::execute() ()
#10 0x00007f15fd9f9b3a in ?? () from /usr/lib/libtbb.so.2
#11 0x00007f15fd9f5816 in ?? () from /usr/lib/libtbb.so.2
#12 0x00007f15fd9f4f4b in ?? () from /usr/lib/libtbb.so.2
#13 0x00007f15fd9f10ff in ?? () from /usr/lib/libtbb.so.2
#14 0x00007f15fd9f12f9 in ?? () from /usr/lib/libtbb.so.2
#15 0x00007f15fdc15182 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#16 0x00007f15fceee47d in clone () from /lib/x86_64-linux-gnu/libc.so.6
(gdb)
[1]+ Stopped gdb /usr/bin/contrail-vrouter-agent /var/crashes/core.contrail-vroute.29468.ContrailVM-a6s44.1462968781
root@ContrailVM-a6s44:~# contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-fabric-utils 3.0.2.0-35 35
contrail-install-packages 3.0.2.0-35~kilo 35
contrail-lib 3.0.2.0-35 35
contrail-nodemgr 3.0.2.0-35 35
contrail-nova-vif 3.0.2.0-35 35
contrail-setup 3.0.2.0-35 35
contrail-utils 3.0.2.0-35 35
contrail-vrouter-3.13.0-40-generic 3.0.2.0-35 35
contrail-vrouter-agent 3.0.2.0-35 35
contrail-vrouter-common 3.0.2.0-35 35
contrail-vrouter-init 3.0.2.0-35 35
contrail-vrouter-utils 3.0.2.0-35 35
python-contrail 3.0.2.0-35 35

Tags: sanity vrouter
shajuvk (shajuvk)
information type: Proprietary → Public
Revision history for this message
shajuvk (shajuvk) wrote :

cores location : /auto/cores/shajuvk/1580733

shajuvk (shajuvk)
summary: - agent crash in vcenter- Vrouter
+ R3.0.2-kilo-agent crash in vcenter- Vrouter
vm@LifetimeManager::DeleteExecutor(LifetimeManager::LifetimeActorRef)
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.0

Review in progress for https://review.opencontrail.org/20225
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/20225
Committed: http://github.org/Juniper/contrail-controller/commit/b961dd5be361d930f00ea0d74fe5a596366096e7
Submitter: Zuul
Branch: R3.0

commit b961dd5be361d930f00ea0d74fe5a596366096e7
Author: Naveen N <email address hidden>
Date: Sat May 14 14:44:23 2016 +0530

* Remove flow mgmt tree lookup in DB context

VRF delete notification happens in DB context,
DB and flow mgmt runs in parallel.
When VRF is deleted flow mgmt tree was lookup
to check if there are any pending flows, since
DB and flow mgmt run in parallel entries can be getting
deleted resulting deleted memory access.
Remove flow mgmt tree access, just enqueue a request
to delete VRF, which inturn verifies if all the flows
are deleted or not.
Closes-bug:#1580733

Change-Id: I976185e0a7a77d9713b284abfdebe70c8b1579bd

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.0

Review in progress for https://review.opencontrail.org/20454
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/20618
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/20618
Committed: http://github.org/Juniper/contrail-controller/commit/66924c3cb215f834e21fcae1e2d95da4cf0bcd4b
Submitter: Zuul
Branch: master

commit 66924c3cb215f834e21fcae1e2d95da4cf0bcd4b
Author: Naveen N <email address hidden>
Date: Sat May 14 14:44:23 2016 +0530

* Remove flow mgmt tree lookup in DB context

VRF delete notification happens in DB context,
DB and flow mgmt runs in parallel.
When VRF is deleted flow mgmt tree was lookup
to check if there are any pending flows, since
DB and flow mgmt run in parallel entries can be getting
deleted resulting deleted memory access.
Remove flow mgmt tree access, just enqueue a request
to delete VRF, which inturn verifies if all the flows
are deleted or not.
Closes-bug:#1580733

Change-Id: I976185e0a7a77d9713b284abfdebe70c8b1579bd

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.