tor-agent crash at logical_switch_name_ == UuidToString
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
R2.20 |
Fix Committed
|
High
|
Prabhjot Singh Sethi | |||
R2.21.x |
Fix Committed
|
High
|
Prabhjot Singh Sethi | |||
R2.22.x |
Fix Committed
|
High
|
Prabhjot Singh Sethi | |||
R3.0 |
Fix Committed
|
High
|
Prabhjot Singh Sethi | |||
Trunk |
Fix Committed
|
High
|
Prabhjot Singh Sethi |
Bug Description
R2.22 Build 115 Ubuntu 14.04 Juno
Was running a test by continuously creating and deleting vms, vns, lifs, vmis and restarting 3 control nodes randomly
Below crash was seen on tor-agent nodes a few times.
Core will be in http://
(gdb) bt
#0 0x00007f6a9b96acc9 in __GI_raise (sig=sig@entry=6) at ../nptl/
#1 0x00007f6a9b96e0d8 in __GI_abort () at abort.c:89
#2 0x00007f6a9b963b86 in __assert_fail_base (fmt=0x7f6a9bab4830 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n",
assertion=
file=
function=
#3 0x00007f6a9b963c32 in __GI___assert_fail (assertion=0xe85d10 "logical_
file=0xe85cc8 "controller/
#4 0x00000000009695f0 in OVSDB::
#5 0x0000000000a9d847 in KSyncDBObject:
#6 0x0000000000d3442a in DBTableBase:
#7 0x0000000000d36f38 in DBTablePartBase
#8 0x0000000000d32d1d in DBPartition:
#9 0x0000000000e34140 in TaskImpl::execute() ()
#10 0x00007f6a9c539b3a in ?? () from /usr/lib/
#11 0x00007f6a9c535816 in ?? () from /usr/lib/
#12 0x00007f6a9c534f4b in ?? () from /usr/lib/
#13 0x00007f6a9c5310ff in ?? () from /usr/lib/
#14 0x00007f6a9c5312f9 in ?? () from /usr/lib/
#15 0x00007f6a9c755182 in start_thread (arg=0x7f6a8eff
#16 0x00007f6a9ba2e47d in clone () at ../sysdeps/
(gdb) quit
----------------
Scripts :
root@nodec1:~# cat test1.sh
source /etc/contrail/
image_id=
while :
do
for i in {1..30};
do
neutron net-create bugvn$i
neutron subnet-create bugvn$i 100.$i.$i.0/24
vn_id=`neutron net-show bugvn$i | grep " id " | awk '{ print $4}'`
nova boot --nic net-id=$vn_id --flavor 1 --image $image_id vm_$i
done
for i in {1..30};
do
nova delete vm_$i
done
for i in {1..30};
do
neutron net-delete bugvn$i
done
done
root@nodec1:~#
root@nodec1:~#
root@nodec1:~# cat bug-recreate.sh
device_
mac="00:
while :
do
neutron net-create bug-vn
neutron subnet-create bug-vn 100.1.1.0/24
vn_id=`neutron net-show bug-vn | grep " id " | awk '{ print $4}'`
python config-tor-intf.py "ge-0/0/0" $device_id "ge-0/0/0.0" 0 1 $vn_id "00:25:90:c3:09:6d"
sleep 20
python del-lifs-vmis.py
neutron net-delete bug-vn
sleep 20
done
root@nodec1:~#
Changed in juniperopenstack: | |
assignee: | Hari Prasad Killi (haripk) → Prabhjot Singh Sethi (prabhjot) |
issue happens due to vn object getting recreated with new UUID, cause vrf to just update to new VN object.
this on notification in OVS KSYNC observes a key change, which is not a handled scenario results in assertion