Juniper Openstack

control-node crash at BgpProtoPrefix::WriteLabel on 2.20 Build 53

  1. Series r2.20
  2. Bug #1466415
Bug #1466415 reported by Vedamurthy Joshi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R2.0
Fix Committed
High
Nischal Sheth
Juniper Openstack r2.02
R2.1
Fix Committed
High
Nischal Sheth
Juniper Openstack r2.11 "r2.11"
R2.20
Fix Committed
High
Nischal Sheth
Juniper Openstack r2.20-fcs
Trunk
Fix Committed
High
Nischal Sheth
Juniper Openstack r3.0-fcs

Bug Description

R2.20 Build 53 Ubuntu 14.04 Juno multi-node

Core will be in http://10.204.216.50/Docs/bugs/#

Not sure what triggered it..any clues from the core will help reproducing..

env.roledefs = {
    'all': [host1, host2, host3, host4, host5, host6, host7],
    'cfgm': [host1,host2,host3],
    'openstack': [host1,host2,host3],
    'control': [host1,host2,host3],
    'compute': [host4,host5, host6, host7],
    'collector': [host1,host2,host3],
    'webui': [host1],
    'database': [host1,host2,host3],
    'toragent': [host6, host7],
    'tsn': [host6, host7],
    'build': [host_build],
}

env.hostnames = {
    'all': ['nodec1', 'nodec2', 'nodec3', 'nodek1', 'nodek2', 'nodek3', 'nodeg11']
}

Core was generated by `/usr/bin/contrail-control'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00007f15a8880cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) bt
#0 0x00007f15a8880cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007f15a88840d8 in __GI_abort () at abort.c:89
#2 0x00007f15a8879b86 in __assert_fail_base (fmt=0x7f15a89ca830 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0xaf7b40 "label <= 0xFFFFFF",
    file=file@entry=0xaf7b68 "controller/src/bgp/bgp_attr_base.cc", line=line@entry=37, function=function@entry=0xaf7bc0 "void BgpProtoPrefix::WriteLabel(size_t, uint32_t, bool)")
    at assert.c:92
#3 0x00007f15a8879c32 in __GI___assert_fail (assertion=0xaf7b40 "label <= 0xFFFFFF", file=0xaf7b68 "controller/src/bgp/bgp_attr_base.cc", line=37,
    function=0xaf7bc0 "void BgpProtoPrefix::WriteLabel(size_t, uint32_t, bool)") at assert.c:101
#4 0x00000000005b7cf0 in ?? ()
#5 0x000000000045079d in ?? ()
#6 0x00000000005c2aec in ?? ()
#7 0x00000000005c3a2b in ?? ()
#8 0x0000000000639979 in ?? ()
#9 0x0000000000639d2d in ?? ()
#10 0x0000000000674a83 in ?? ()
#11 0x00000000006799c5 in ?? ()
#12 0x0000000000aafa60 in ?? ()
#13 0x00007f15a9657b3a in ?? () from /usr/lib/libtbb.so.2
#14 0x00007f15a9653816 in ?? () from /usr/lib/libtbb.so.2
#15 0x00007f15a9652f4b in ?? () from /usr/lib/libtbb.so.2
#16 0x00007f15a964f0ff in ?? () from /usr/lib/libtbb.so.2
#17 0x00007f15a964f2f9 in ?? () from /usr/lib/libtbb.so.2
#18 0x00007f15a9873182 in start_thread (arg=0x7f15a1cfb700) at pthread_create.c:312
#19 0x00007f15a894447d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
(gdb) quit

Revision history for this message
Prakash Bailkeri (prakashmb) wrote :
Download full text (6.1 KiB)

#0 0x00007f15a8880cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007f15a88840d8 in __GI_abort () at abort.c:89
#2 0x00007f15a8879b86 in __assert_fail_base (fmt=0x7f15a89ca830 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0xaf7b40 "label <= 0xFFFFFF",
    file=file@entry=0xaf7b68 "controller/src/bgp/bgp_attr_base.cc", line=line@entry=37,
    function=function@entry=0xaf7bc0 <BgpProtoPrefix::WriteLabel(unsigned long, unsigned int, bool)::__PRETTY_FUNCTION__> "void BgpProtoPrefix::WriteLabel(size_t, uint32_t, bool)") at assert.c:92
#3 0x00007f15a8879c32 in __GI___assert_fail (assertion=0xaf7b40 "label <= 0xFFFFFF", file=0xaf7b68 "controller/src/bgp/bgp_attr_base.cc", line=37,
    function=0xaf7bc0 <BgpProtoPrefix::WriteLabel(unsigned long, unsigned int, bool)::__PRETTY_FUNCTION__> "void BgpProtoPrefix::WriteLabel(size_t, uint32_t, bool)") at assert.c:101
#4 0x00000000005b7cf0 in BgpProtoPrefix::WriteLabel (this=this@entry=0x7f159c03f570, label_offset=label_offset@entry=22, label=label@entry=4294967295, is_vni=is_vni@entry=true)
    at controller/src/bgp/bgp_attr_base.cc:37
#5 0x000000000045079d in WriteLabel (label=4294967295, offset=22, attr=0x7f1598535600, proto_prefix=0x7f159c03f570) at controller/src/bgp/evpn/evpn_route.cc:61
#6 EvpnPrefix::BuildProtoPrefix (this=0x7f159c55afd8, attr=0x7f1598535600, label=4294967295, proto_prefix=0x7f159c03f570) at controller/src/bgp/evpn/evpn_route.cc:260
#7 0x00000000005c2aec in BgpMessage::StartReach (this=this@entry=0x7f159c5d8300, roattr=roattr@entry=0x7f159d2a9418, route=route@entry=0x7f159c55af40) at controller/src/bgp/bgp_message_builder.cc:125
#8 0x00000000005c3a2b in Start (route=0x7f159c55af40, roattr=0x7f159d2a9418, this=0x7f159c5d8300) at controller/src/bgp/bgp_message_builder.cc:171
#9 BgpMessageBuilder::Create (this=<optimized out>, table=0x1d5df10, roattr=0x7f159d2a9418, route=0x7f159c55af40) at controller/src/bgp/bgp_message_builder.cc:241
#10 0x0000000000639979 in RibOutUpdates::DequeueCommon (this=this@entry=0x7f159c3e1f90, marker=marker@entry=0x7f159c3e2078, rt_update=0x7f159c692d30, blocked=blocked@entry=0x7f15a1cfab30)
    at controller/src/bgp/bgp_ribout_updates.cc:120
#11 0x0000000000639d2d in RibOutUpdates::TailDequeue (this=0x7f159c3e1f90, queue_id=1, msync=..., blocked=0x7f15a1cfab30) at controller/src/bgp/bgp_ribout_updates.cc:197
#12 0x0000000000674a83 in SchedulingGroup::UpdateRibOut (this=0x7f158c33c570, ribout=0x7f159c3e1d60, queue_id=1) at controller/src/bgp/scheduling_group.cc:1070
#13 0x00000000006799c5 in SchedulingGroup::Worker::Run (this=0x7f159c4cc150) at controller/src/bgp/scheduling_group.cc:425
#14 0x0000000000aafa60 in TaskImpl::execute (this=0x7f15a20d4140) at controller/src/base/task.cc:238
#15 0x00007f15a9657b3a in ?? () from /usr/lib/libtbb.so.2
#16 0x00007f15a9653816 in ?? () from /usr/lib/libtbb.so.2
#17 0x00007f15a9652f4b in ?? () from /usr/lib/libtbb.so.2
#18 0x00007f15a964f0ff in ?? () from /usr/lib/libtbb.so.2
#19 0x00007f15a964f2f9 in ?? () from /usr/lib/libtbb.so.2
#20 0x00007f15a9873182 in start_thread (arg=0x7f15a1cfb700) at pthread_create.c:312
#21 0x00007f15a894447d in clone...

Read more...

Changed in juniperopenstack:
assignee: nobody → Nischal Sheth (nsheth)
Revision history for this message
Prakash Bailkeri (prakashmb) wrote :

# Route on MX
root@walsh> show route table __default_evpn__.evpn.0 extensive

__default_evpn__.evpn.0: 4 destinations, 4 routes (4 active, 0 holddown, 0 hidden)
1:7.7.7.77:0::050000fc000000019000::FFFF:FFFF/304 (1 entry, 1 announced)
TSI:
RTF { 64512:5000/64 }
Page 0 idx 1, (group nodec22-evpn-vn1 type Internal) Type 1 val 0x3156a1c (adv_entry)
   Advertised metrics:
     Flags: Nexthop Change
     Nexthop: Self
     Localpref: 100
     AS path: [64512] I
     Communities: target:64512:5000 encapsulation0:0:0:0:vxlan esi-label:all-active (label 0)
    Advertise: 00000005
Path 1:7.7.7.77:0::050000fc000000019000::FFFF:FFFF Vector len 4. Val: 1
        *EVPN Preference: 170
                Next hop type: Indirect
                Address: 0x28f5858
                Next-hop reference count: 19
                Protocol next hop: 7.7.7.77
                Indirect next hop: 0x0 - INH Session ID: 0x0
                State: <Active Int Ext>
                Age: 1d 3:28:42
                Validation State: unverified
                Task: __default_evpn__-evpn
                Announcement bits (2): 1-BGP Route Target 2-BGP_RT_Background
                AS path: I
                Communities: target:64512:5000 encapsulation0:0:0:0:vxlan esi-label:all-active (label 0)

OpenContrail Admin (ci-admin-f)
tags: added: blocker bms
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.20

Review in progress for https://review.opencontrail.org/11798
Submitter: Nischal Sheth (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/11800
Submitter: Nischal Sheth (<email address hidden>)

Nischal Sheth (nsheth)
tags: added: contrail-control
removed: bgp
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/11800
Committed: http://github.org/Juniper/contrail-controller/commit/f57fa85b8af6b5abd19d87089385a8b37cbac073
Submitter: Zuul
Branch: master

commit f57fa85b8af6b5abd19d87089385a8b37cbac073
Author: Nischal Sheth <email address hidden>
Date: Thu Jun 18 10:45:34 2015 -0700

Do not use tag greater than kMaxVni as label with VXLAN encap

Change-Id: Ib3fa91bef2426b9e1b72725ef1d010cb00195d80
Closes-Bug: 1466415

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/11798
Committed: http://github.org/Juniper/contrail-controller/commit/15d6e4010524bfae76f9db9fb611f11d9c769184
Submitter: Zuul
Branch: R2.20

commit 15d6e4010524bfae76f9db9fb611f11d9c769184
Author: Nischal Sheth <email address hidden>
Date: Thu Jun 18 10:45:34 2015 -0700

Do not use tag greater than kMaxVni as label with VXLAN encap

Change-Id: Ib3fa91bef2426b9e1b72725ef1d010cb00195d80
Closes-Bug: 1466415

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.1

Review in progress for https://review.opencontrail.org/11897
Submitter: Nischal Sheth (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.0

Review in progress for https://review.opencontrail.org/11898
Submitter: Nischal Sheth (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.1

Review in progress for https://review.opencontrail.org/11897
Submitter: Nischal Sheth (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/11898
Committed: http://github.org/Juniper/contrail-controller/commit/393a19586afe679328a8e2cb728ec58dfc8d9a53
Submitter: Zuul
Branch: R2.0

commit 393a19586afe679328a8e2cb728ec58dfc8d9a53
Author: Nischal Sheth <email address hidden>
Date: Sat Jun 20 11:56:11 2015 -0700

Do not use tag greater than kMaxVni as label with VXLAN encap

Change-Id: Icffda48af9b64c3afe0ab610b38f66693fc5a3ff
Closes-Bug: 1466415

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/11897
Committed: http://github.org/Juniper/contrail-controller/commit/35c2a977c6ab9ba6e8aaabced16650c7e195faee
Submitter: Zuul
Branch: R2.1

commit 35c2a977c6ab9ba6e8aaabced16650c7e195faee
Author: Nischal Sheth <email address hidden>
Date: Sat Jun 20 11:56:11 2015 -0700

Do not use tag greater than kMaxVni as label with VXLAN encap

Change-Id: Icffda48af9b64c3afe0ab610b38f66693fc5a3ff
Closes-Bug: 1466415

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.