core generated by router agent

Bug #1731148 reported by Venkatesh Velpula
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.1
Fix Committed
High
Unassigned
Trunk
Fix Committed
High
Unassigned

Bug Description

build-id :38(4.1.0.0-38)
build type :continuous build
DISTRO. :Ubuntu 16.04.2 LTS
SKU :newton

Setup(open stack HA)
===================================================

controller+openstack: - nodec19, nodec20, nodec21
contrail-lb - nodea35
compute - nodei16, nodei18,nodea4

====================================================

(gdb) bt
#0 0x00007f63b8e58428 in raise () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f63b8e5a02a in abort () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x00007f63b8e50bd7 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#3 0x00007f63b8e50c82 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
#4 0x00000000012bd0ad in InterfaceUveTable::UveInterfaceEntry::UpdateCounters(FlowUveFwPolicyInfo const&, InterfaceUveTable::UveSecurityPolicyStats*) ()
#5 0x00000000012c1c56 in InterfaceUveTable::UveInterfaceEntry::UpdateInterfaceFwPolicyStats(FlowUveFwPolicyInfo const&) ()
#6 0x0000000000fdbc0b in StatsManager::DeleteFlow(FlowUveStatsRequest const*) ()
#7 0x0000000000fdc2bd in StatsManager::RequestHandler(boost::shared_ptr<FlowUveStatsRequest>) ()
#8 0x0000000000fdd6af in boost::detail::function::function_obj_invoker1<boost::_bi::bind_t<bool, boost::_mfi::mf1<bool, StatsManager, boost::shared_ptr<FlowUveStatsRequest> >, boost::_bi::list2<boost::_bi::value<StatsManager*>, boost::arg<1> > >, bool, boost::shared_ptr<FlowUveStatsRequest> >::invoke(boost::detail::function::function_buffer&, boost::shared_ptr<FlowUveStatsRequest>) ()
#9 0x0000000000fe036e in QueueTaskRunner<boost::shared_ptr<FlowUveStatsRequest>, WorkQueue<boost::shared_ptr<FlowUveStatsRequest> > >::RunQueue() ()
#10 0x000000000180b1cd in TaskImpl::execute() ()
#11 0x00007f63b9ab3fdd in ?? () from /usr/lib/x86_64-linux-gnu/libtbb.so.2
#12 0x00007f63b9aad0dc in ?? () from /usr/lib/x86_64-linux-gnu/libtbb.so.2
#13 0x00007f63b9aabfd3 in ?? () from /usr/lib/x86_64-linux-gnu/libtbb.so.2
#14 0x00007f63b9aa7a91 in ?? () from /usr/lib/x86_64-linux-gnu/libtbb.so.2
#15 0x00007f63b9aa7cf9 in ?? () from /usr/lib/x86_64-linux-gnu/libtbb.so.2
#16 0x00007f63b9cd16ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#17 0x00007f63b8f2982d in clone () from /lib/x86_64-linux-gnu/libc.so.6
(gdb)

 core file can be found @/cs-shared/bugs/1731148

root@nodei16:/var/crashes# contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-lib 4.1.0.0-38 38
contrail-nodemgr 4.1.0.0-38 38
contrail-setup 4.1.0.0-38 38
contrail-utils 4.1.0.0-38 38
contrail-vrouter-agent 4.1.0.0-38 38
contrail-vrouter-common 4.1.0.0-38 38
contrail-vrouter-dkms 4.1.0.0-38 38
contrail-vrouter-init 4.1.0.0-38 38
contrail-vrouter-utils 4.1.0.0-38 38
nova-common 2:14.0.2-0ubuntu1~cloud0.1contrail 38
nova-compute 2:14.0.2-0ubuntu1~cloud0.1contrail 38
nova-compute-kvm 2:14.0.2-0ubuntu1~cloud0.1contrail 38
nova-compute-libvirt 2:14.0.2-0ubuntu1~cloud0.1contrail 38
python-contrail 4.1.0.0-38 38
python-contrail-vrouter-api 4.1.0.0-38 38
python-neutronclient 1:6.0.0-0ubuntu1~cloud0.2contrail 38
python-nova 2:14.0.2-0ubuntu1~cloud0.1contrail 38
python-opencontrail-vrouter-netns 4.1.0.0-38 38
root@nodei16:/var/crashes# contrail-status
== Contrail vRouter ==
contrail-vrouter-agent: active
contrail-vrouter-nodemgr: active
========Run time service failures=============
/var/crashes/core.contrail-vroute.2568.nodei16.1510198956

root@nodec21:~# /opt/contrail/contrail_server_manager/provision_status.sh

+---------+---------------------+----------------+-------------------+
| id | status | ip_address | mac_address |
+---------+---------------------+----------------+-------------------+
| nodec19 | provision_completed | 10.204.217.4 | 00:25:90:C3:AF:AA |
| nodec20 | provision_completed | 10.204.217.5 | 00:25:90:C3:08:6A |
| nodec21 | provision_completed | 10.204.217.6 | 00:25:90:C3:3F:12 |
| nodea4 | provision_completed | 10.204.216.120 | 00:25:90:A5:3B:12 |
| nodei18 | provision_completed | 10.204.217.130 | 00:25:90:E7:7E:FC |
| nodei16 | provision_completed | 10.204.217.128 | 00:25:90:E7:80:30 |
| nodea35 | provision_completed | 10.204.216.31 | 00:25:90:AA:A9:44 |
+---------+---------------------+----------------+-------------------+

+---------+---------------------------+-------------------+-----------------------+------------------------------------------------------------------------------------+
| id | cluster_id | provision_pending | provision_in_progress | provision_completed |
+---------+---------------------------+-------------------+-----------------------+------------------------------------------------------------------------------------+
| nodec19 | clusterc19c20c21a35i16i18 | [] | [] | ['openstack', 'contrail-controller', 'contrail-analyticsdb', 'contrail-analytics'] |
| nodec20 | clusterc19c20c21a35i16i18 | [] | [] | ['openstack', 'contrail-controller', 'contrail-analyticsdb', 'contrail-analytics'] |
| nodec21 | clusterc19c20c21a35i16i18 | [] | [] | ['openstack', 'contrail-controller', 'contrail-analyticsdb', 'contrail-analytics'] |
| nodea4 | clusterc19c20c21a35i16i18 | [] | [] | ['contrail-compute'] |
| nodei18 | clusterc19c20c21a35i16i18 | [] | [] | ['contrail-compute'] |
| nodei16 | clusterc19c20c21a35i16i18 | [] | [] | ['contrail-compute'] |
| nodea35 | clusterc19c20c21a35i16i18 | [] | [] | ['contrail-lb'] |
+---------+---------------------------+-------------------+-----------------------+------------------------------------------------------------------------------------+
root@nodec21:~#

Tags: vrouter
description: updated
Changed in juniperopenstack:
milestone: none → r4.1.1.0
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/37351
Submitter: Ashok Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37351
Committed: http://github.com/Juniper/contrail-controller/commit/4bd1d18da33b4fbbef378e38fd0da7bbe9531164
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 4bd1d18da33b4fbbef378e38fd0da7bbe9531164
Author: Ashok Singh R <email address hidden>
Date: Thu Nov 9 14:55:11 2017 +0530

Fix agent crash due to incorrect comparison function

Change-Id: I41a301f0ef9939560a26d3be9ade11c8bd5d76cb
Closes-Bug: #1731148

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/37381
Submitter: Ashok Singh (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37381
Committed: http://github.com/Juniper/contrail-controller/commit/f595bcbda7b51db8eb8b025ce87df221a2f603fd
Submitter: Zuul (<email address hidden>)
Branch: master

commit f595bcbda7b51db8eb8b025ce87df221a2f603fd
Author: Ashok Singh R <email address hidden>
Date: Thu Nov 9 14:55:11 2017 +0530

Fix agent crash due to incorrect comparison function

Closes-Bug: #1731148
(cherry picked from commit 4bd1d18da33b4fbbef378e38fd0da7bbe9531164)

Change-Id: If856af56afbdbbdd07223da50c81b4d2d9b088b4

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.