Activity log for bug #1653479

Date Who What changed Old value New value Message
2017-01-02 06:14:12 kalagesan bug added bug
2017-01-02 06:15:09 kalagesan tags qfx
2017-01-04 02:31:51 Jeba Paulaiyan tags qfx qfx vrouter
2017-01-04 02:32:03 Jeba Paulaiyan nominated for series juniperopenstack/r3.1
2017-01-04 02:32:03 Jeba Paulaiyan bug task added juniperopenstack/r3.1
2017-01-04 02:32:03 Jeba Paulaiyan nominated for series juniperopenstack/r3.2
2017-01-04 02:32:03 Jeba Paulaiyan bug task added juniperopenstack/r3.2
2017-01-04 02:32:03 Jeba Paulaiyan nominated for series juniperopenstack/trunk
2017-01-04 02:32:03 Jeba Paulaiyan bug task added juniperopenstack/trunk
2017-01-04 02:32:09 Jeba Paulaiyan juniperopenstack/r3.1: importance Undecided High
2017-01-04 02:32:12 Jeba Paulaiyan juniperopenstack/r3.2: importance Undecided High
2017-01-04 02:32:14 Jeba Paulaiyan juniperopenstack/trunk: importance Undecided High
2017-01-04 02:32:18 Jeba Paulaiyan juniperopenstack/trunk: milestone r4.0
2017-01-04 12:34:01 kalagesan description * version contrail v3.1.1.0-45 QFX4 v14.1X53-D33 QFX11 v14.1X53-D33.2 * tor-agent and QFX QFX4(172.23.11.45): tor-agent-4 QFX11(172.23.11.37): tor-agent-11 * topology diagram [IXIA]===[QFX4]====[VXLAN]====[QFX11]===[IXIA] customer configured 500 virtual-network on Contrail. customer applied the traffic to each virtual-network and tested the failure of TSN node. when our customer stop of tor-agent process by one TSN node(172.23.10.196), communication disconnection occurred on 76/500VN. The customer picked up from the communication disconnected VN and confirmed the BUM Tree. The BUM Tree of the picked up VN was broken. * BUM Tree status [The BUM Tree status before stop tor-agent] via TSN(172.23.10.196) QFX4-----(multicast:33:33:33:33:33:33)----->QFX11 QFX4<----(broadcast:ff:ff:ff:ff:ff:ff)------QFX11 *500VN [stop tor-agent in TSN(172.23.10.196)] ----- root@openc-14:~# date Thu Dec 15 16:42:03 JST 2016 root@openc-14:~# service contrail-tor-agent-4 stop date contrail-tor-agent-4: stopped root@openc-14:~# date Thu Dec 15 16:42:04 JST 2016 ----- [Expected behavior] Change BUM Tree via TSN(172.23.10.197)-TSN(172.23.10.196) QFX4-----(multicast:33:33:33:33:33:33)----->QFX11 QFX4<----(broadcast:ff:ff:ff:ff:ff:ff)------QFX11 *500VN [Pickup VN1] It is broken BUMTree. Check TSN(172.23.10.197) root@openc-15:~# vxlan --get 524 VXLAN Table VNID NextHop ---------------- 524 640 root@openc-15:~# nh --get 640 Id:640 Type:Vrf_Translate Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:1978 Flags:Valid, Vxlan, Unicast Flood, Vrf:1978 root@openc-15:~# rt --family bridge --dump 1978 Flags: L=Label Valid, Df=DHCP flood vRouter bridge table 0/1978 Index DestMac Flags Label/VNID Nexthop 51356 90:1b:e:52:bb:ea Df - 3 296020 30:20:0:8:0:3 - 1 367936 ff:ff:ff:ff:ff:ff LDf 524 13327 909752 30:20:0:8:0:4 - 1 974164 30:48:4:0:0:8 LDf 524 16 root@openc-15:~# nh --get 13327 Id:13327 Type:Composite Fmly:AF_BRIDGE Rid:0 Ref_cnt:3 Vrf:1978 Flags:Valid, Multicast, L2, Sub NH(label): 13318(0) 13040(0) Id:13318 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:1978 Flags:Valid, Tor, Sub NH(label): 16(524) Id:16 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:41360 Vrf:0 Flags:Valid, Vxlan, Oif:0 Len:14 Flags Valid, Vxlan, Data:5c 5e ab 03 57 f0 90 1b 0e 52 bb ea 08 00 Vrf:0 Sip:172.23.10.197 Dip:172.23.11.45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<QFX4 Id:13040 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:1978 Flags:Valid, Evpn, Sub NH(label): There is a path of QFX4. However,there is no path to other TSN node(172.23.10.196). [Pickup VN2] It is normal status. Check TSN(172.23.10.197) root@openc-15:~# vxlan --get 518 VXLAN Table VNID NextHop ---------------- 518 1302 root@openc-15:~# nh --get 1302 Id:1302 Type:Vrf_Translate Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Vxlan, Unicast Flood, Vrf:2448 root@openc-15:~# rt --family bridge --dump 2448 Flags: L=Label Valid, Df=DHCP flood vRouter bridge table 0/2448 Index DestMac Flags Label/VNID Nexthop 59857 30:20:0:2:0:4 - 1 249460 30:48:4:0:0:2 LDf 518 16 344168 30:48:8:0:0:2 LDf 518 17 446440 30:20:0:2:0:3 - 1 522112 ff:ff:ff:ff:ff:ff LDf 518 12521 722868 90:1b:e:52:bb:ea Df - 3 root@openc-15:~# nh --get 12521 Id:12521 Type:Composite Fmly:AF_BRIDGE Rid:0 Ref_cnt:4 Vrf:2448 Flags:Valid, Multicast, L2, Sub NH(label): 10434(0) 12254(0) 4507(0) Id:10434 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Tor, Sub NH(label): 16(518) Id:16 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:41360 Vrf:0 Flags:Valid, Vxlan, Oif:0 Len:14 Flags Valid, Vxlan, Data:5c 5e ab 03 57 f0 90 1b 0e 52 bb ea 08 00 Vrf:0 Sip:172.23.10.197 Dip:172.23.11.45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<QFX4 Id:12254 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Evpn, Sub NH(label): Id:4507 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Fabric, Sub NH(label): 1584(191914) Id:1584 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:2047 Vrf:0 Flags:Valid, MPLSoGRE, Oif:0 Len:14 Flags Valid, MPLSoGRE, Data:90 1b 0e 44 2c b5 90 1b 0e 52 bb ea 08 00 Vrf:0 Sip:172.23.10.197 Dip:172.23.10.196 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Connection between TSN and TSN Check TSN(172.23.10.196) root@openc-14:~# vxlan --get 518 VXLAN Table VNID NextHop ---------------- 518 12002 root@openc-14:~# nh --get 12002 Id:12002 Type:Vrf_Translate Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Vxlan, Unicast Flood, Vrf:483 root@openc-14:~# rt --family bridge --dump 483 Flags: L=Label Valid, Df=DHCP flood vRouter bridge table 0/483 Index DestMac Flags Label/VNID Nexthop 25892 90:1b:e:44:2c:b5 Df - 3 66856 30:48:4:0:0:2 LDf 518 15 153520 ff:ff:ff:ff:ff:ff LDf 518 17808 289320 30:20:0:2:0:4 - 1 315000 30:20:0:2:0:3 - 1 752656 0:0:5e:0:1:0 Df - 3 785920 30:48:8:0:0:2 LDf 518 16 root@openc-14:~# nh --get 17808 Id:17808 Type:Composite Fmly:AF_BRIDGE Rid:0 Ref_cnt:4 Vrf:483 Flags:Valid, Multicast, L2, Sub NH(label): 17803(0) 13643(0) 8469(0) Id:17803 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Tor, Sub NH(label): 16(518) Id:16 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:1506 Vrf:0 Flags:Valid, Vxlan, Oif:0 Len:14 Flags Valid, Vxlan, Data:5c 5e ab 03 57 f0 90 1b 0e 44 2c b5 08 00 Vrf:0 Sip:172.23.10.196 Dip:172.23.11.37 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<QFX11 Id:13643 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Evpn, Sub NH(label): Id:8469 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Fabric, Sub NH(label): 1555(190816) Id:1555 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:2047 Vrf:0 Flags:Valid, MPLSoGRE, Oif:0 Len:14 Flags Valid, MPLSoGRE, Data:90 1b 0e 52 bb ea 90 1b 0e 44 2c b5 08 00 Vrf:0 Sip:172.23.10.196 Dip:172.23.10.197 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Connection between TSN and TSN customer like to understand root cause about this issue from the logs provided Below files are collected from customer and its available in my local log server: root@10.219.48.123, pwd:Jtaclab123 fileupload directory path:/home/kannan/bumtree Contrail: testbed.py under /var/log/contrail logs. gcore file of tor-agent process. QFX: RSI under /var/log archive VN information on communication disconnection * version contrail v3.1.1.0-45 QFX4 v14.1X53-D33 QFX11 v14.1X53-D33.2 * tor-agent and QFX QFX4(172.23.11.45): tor-agent-4 QFX11(172.23.11.37): tor-agent-11 * topology diagram [IXIA]===[QFX4]====[VXLAN]====[QFX11]===[IXIA] customer configured 500 virtual-network on Contrail. customer applied the traffic to each virtual-network and tested the failure of TSN node. when our customer stop of tor-agent process by one TSN node(172.23.10.196), communication disconnection occurred on 76/500VN. The customer picked up from the communication disconnected VN and confirmed the BUM Tree. The BUM Tree of the picked up VN was broken. * BUM Tree status [The BUM Tree status before stop tor-agent] via TSN(172.23.10.196) QFX4-----(multicast:33:33:33:33:33:33)----->QFX11 QFX4<----(broadcast:ff:ff:ff:ff:ff:ff)------QFX11 *500VN [stop tor-agent in TSN(172.23.10.196)] ----- root@openc-14:~# date Thu Dec 15 16:42:03 JST 2016 root@openc-14:~# service contrail-tor-agent-4 stop date contrail-tor-agent-4: stopped root@openc-14:~# date Thu Dec 15 16:42:04 JST 2016 ----- [Expected behavior] Change BUM Tree via TSN(172.23.10.197)-TSN(172.23.10.196) QFX4-----(multicast:33:33:33:33:33:33)----->QFX11 QFX4<----(broadcast:ff:ff:ff:ff:ff:ff)------QFX11 *500VN [Pickup VN1] It is broken BUMTree. Check TSN(172.23.10.197) root@openc-15:~# vxlan --get 524 VXLAN Table VNID NextHop ---------------- 524 640 root@openc-15:~# nh --get 640 Id:640 Type:Vrf_Translate Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:1978 Flags:Valid, Vxlan, Unicast Flood, Vrf:1978 root@openc-15:~# rt --family bridge --dump 1978 Flags: L=Label Valid, Df=DHCP flood vRouter bridge table 0/1978 Index DestMac Flags Label/VNID Nexthop 51356 90:1b:e:52:bb:ea Df - 3 296020 30:20:0:8:0:3 - 1 367936 ff:ff:ff:ff:ff:ff LDf 524 13327 909752 30:20:0:8:0:4 - 1 974164 30:48:4:0:0:8 LDf 524 16 root@openc-15:~# nh --get 13327 Id:13327 Type:Composite Fmly:AF_BRIDGE Rid:0 Ref_cnt:3 Vrf:1978 Flags:Valid, Multicast, L2, Sub NH(label): 13318(0) 13040(0) Id:13318 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:1978 Flags:Valid, Tor, Sub NH(label): 16(524) Id:16 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:41360 Vrf:0 Flags:Valid, Vxlan, Oif:0 Len:14 Flags Valid, Vxlan, Data:5c 5e ab 03 57 f0 90 1b 0e 52 bb ea 08 00 Vrf:0 Sip:172.23.10.197 Dip:172.23.11.45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<QFX4 Id:13040 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:1978 Flags:Valid, Evpn, Sub NH(label): There is a path of QFX4. However,there is no path to other TSN node(172.23.10.196). [Pickup VN2] It is normal status. Check TSN(172.23.10.197) root@openc-15:~# vxlan --get 518 VXLAN Table VNID NextHop ---------------- 518 1302 root@openc-15:~# nh --get 1302 Id:1302 Type:Vrf_Translate Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Vxlan, Unicast Flood, Vrf:2448 root@openc-15:~# rt --family bridge --dump 2448 Flags: L=Label Valid, Df=DHCP flood vRouter bridge table 0/2448 Index DestMac Flags Label/VNID Nexthop 59857 30:20:0:2:0:4 - 1 249460 30:48:4:0:0:2 LDf 518 16 344168 30:48:8:0:0:2 LDf 518 17 446440 30:20:0:2:0:3 - 1 522112 ff:ff:ff:ff:ff:ff LDf 518 12521 722868 90:1b:e:52:bb:ea Df - 3 root@openc-15:~# nh --get 12521 Id:12521 Type:Composite Fmly:AF_BRIDGE Rid:0 Ref_cnt:4 Vrf:2448 Flags:Valid, Multicast, L2, Sub NH(label): 10434(0) 12254(0) 4507(0) Id:10434 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Tor, Sub NH(label): 16(518) Id:16 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:41360 Vrf:0 Flags:Valid, Vxlan, Oif:0 Len:14 Flags Valid, Vxlan, Data:5c 5e ab 03 57 f0 90 1b 0e 52 bb ea 08 00 Vrf:0 Sip:172.23.10.197 Dip:172.23.11.45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<QFX4 Id:12254 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Evpn, Sub NH(label): Id:4507 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:2448 Flags:Valid, Fabric, Sub NH(label): 1584(191914) Id:1584 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:2047 Vrf:0 Flags:Valid, MPLSoGRE, Oif:0 Len:14 Flags Valid, MPLSoGRE, Data:90 1b 0e 44 2c b5 90 1b 0e 52 bb ea 08 00 Vrf:0 Sip:172.23.10.197 Dip:172.23.10.196 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Connection between TSN and TSN Check TSN(172.23.10.196) root@openc-14:~# vxlan --get 518 VXLAN Table VNID NextHop ---------------- 518 12002 root@openc-14:~# nh --get 12002 Id:12002 Type:Vrf_Translate Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Vxlan, Unicast Flood, Vrf:483 root@openc-14:~# rt --family bridge --dump 483 Flags: L=Label Valid, Df=DHCP flood vRouter bridge table 0/483 Index DestMac Flags Label/VNID Nexthop 25892 90:1b:e:44:2c:b5 Df - 3 66856 30:48:4:0:0:2 LDf 518 15 153520 ff:ff:ff:ff:ff:ff LDf 518 17808 289320 30:20:0:2:0:4 - 1 315000 30:20:0:2:0:3 - 1 752656 0:0:5e:0:1:0 Df - 3 785920 30:48:8:0:0:2 LDf 518 16 root@openc-14:~# nh --get 17808 Id:17808 Type:Composite Fmly:AF_BRIDGE Rid:0 Ref_cnt:4 Vrf:483 Flags:Valid, Multicast, L2, Sub NH(label): 17803(0) 13643(0) 8469(0) Id:17803 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Tor, Sub NH(label): 16(518) Id:16 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:1506 Vrf:0 Flags:Valid, Vxlan, Oif:0 Len:14 Flags Valid, Vxlan, Data:5c 5e ab 03 57 f0 90 1b 0e 44 2c b5 08 00 Vrf:0 Sip:172.23.10.196 Dip:172.23.11.37 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<QFX11 Id:13643 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Evpn, Sub NH(label): Id:8469 Type:Composite Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:483 Flags:Valid, Fabric, Sub NH(label): 1555(190816) Id:1555 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:2047 Vrf:0 Flags:Valid, MPLSoGRE, Oif:0 Len:14 Flags Valid, MPLSoGRE, Data:90 1b 0e 52 bb ea 90 1b 0e 44 2c b5 08 00 Vrf:0 Sip:172.23.10.196 Dip:172.23.10.197 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< Connection between TSN and TSN Customer tried recover of this issue. Recorvery step is below. 1. Stop and start TSN(172.23.10.196)'s contrail-tor-agent-4 -> Not recover. The BUM Tree is broken yet. 2. Restart TSN(172.23.10.196)'s supervisor-vrouter -> This issue recoverd. The BUM Tree is normal. customer like to understand root cause about this issue from the logs provided Below files are collected from customer and its available in my local log server: root@10.219.48.123, pwd:Jtaclab123 fileupload directory path:/home/kannan/bumtree Contrail: testbed.py under /var/log/contrail logs. gcore file of tor-agent process. QFX: RSI under /var/log archive VN information on communication disconnection
2017-01-05 22:06:32 Jeba Paulaiyan juniperopenstack/r3.1: milestone r3.1.2.0
2017-01-05 22:06:34 Jeba Paulaiyan juniperopenstack/r3.2: milestone r3.2.1.0
2017-01-13 11:19:50 Hari Prasad Killi juniperopenstack/r3.1: assignee Manish Singh (manishs)
2017-01-13 11:19:56 Hari Prasad Killi juniperopenstack/r3.2: assignee Manish Singh (manishs)
2017-01-13 11:20:03 Hari Prasad Killi juniperopenstack/trunk: assignee Manish Singh (manishs)
2017-01-18 00:40:58 vivekananda shenoy tags qfx vrouter nttc qfx vrouter
2017-01-18 01:08:24 vivekananda shenoy tags nttc qfx vrouter nttc qfx vrouter vrouter3.1-45
2017-01-19 06:56:50 kalagesan bug added subscriber ctct-sup
2017-01-24 12:03:06 kalagesan attachment added topology before and during issue https://bugs.launchpad.net/juniperopenstack/+bug/1653479/+attachment/4808565/+files/12thjan%20sv2.pptx
2017-01-24 12:03:07 kalagesan attachment added topology before and during issue https://bugs.launchpad.net/juniperopenstack/+bug/1653479/+attachment/4808566/+files/12thjan%20sv2.pptx
2017-01-24 20:20:04 Jeba Paulaiyan juniperopenstack/r3.1: milestone r3.1.2.0 r3.1.3.0
2017-03-07 19:59:21 Jeba Paulaiyan juniperopenstack/r3.2: milestone r3.2.1.0 r3.2.2.0
2017-03-22 22:20:58 Jeba Paulaiyan juniperopenstack/r3.2: milestone r3.2.2.0 r3.2.3.0
2017-03-27 06:10:01 Hari Prasad Killi juniperopenstack/r3.1: status New Invalid
2017-03-27 06:10:04 Hari Prasad Killi juniperopenstack/r3.2: status New Invalid
2017-03-27 06:10:07 Hari Prasad Killi juniperopenstack/trunk: status New Invalid
2017-04-03 11:13:49 kalagesan juniperopenstack/r3.1: status Invalid In Progress
2017-04-03 11:13:56 kalagesan juniperopenstack/r3.2: status Invalid In Progress
2017-04-03 11:14:00 kalagesan juniperopenstack/trunk: status Invalid In Progress
2017-04-11 08:31:29 Manish Singh juniperopenstack/trunk: status In Progress Invalid
2017-04-11 08:46:00 Hari Prasad Killi juniperopenstack/r3.2: status In Progress Invalid
2017-04-11 08:46:03 Hari Prasad Killi juniperopenstack/r3.1: status In Progress Invalid
2017-04-17 05:52:45 kalagesan information type Proprietary Public
2017-06-05 21:29:02 vivekananda shenoy juniperopenstack/r3.1: status Invalid New
2017-06-05 21:29:04 vivekananda shenoy juniperopenstack/r3.2: status Invalid New
2017-06-05 21:29:06 vivekananda shenoy juniperopenstack/trunk: status Invalid New
2017-06-06 04:32:35 Jeba Paulaiyan nominated for series juniperopenstack/r4.0
2017-06-06 04:32:35 Jeba Paulaiyan bug task added juniperopenstack/r4.0
2017-06-06 04:35:25 Jeba Paulaiyan juniperopenstack/r4.0: importance Undecided High
2017-06-06 04:35:34 Jeba Paulaiyan juniperopenstack/r4.0: assignee Manish Singh (manishs)
2017-06-06 04:35:37 Jeba Paulaiyan juniperopenstack/r4.0: milestone r4.0.1.0
2017-06-06 04:35:40 Jeba Paulaiyan juniperopenstack/trunk: milestone r4.0.0.0-fcs r4.1.0.0-fcs
2017-06-16 08:15:18 Manish Singh juniperopenstack/r3.1: assignee Manish Singh (manishs) Ananth Suryanarayana (anantha-l)
2017-06-16 08:15:57 Manish Singh juniperopenstack/r3.2: assignee Manish Singh (manishs) Ananth Suryanarayana (anantha-l)
2017-06-16 08:16:11 Manish Singh juniperopenstack/r4.0: assignee Manish Singh (manishs) Ananth Suryanarayana (anantha-l)
2017-06-16 08:16:23 Manish Singh juniperopenstack/trunk: assignee Manish Singh (manishs) Ananth Suryanarayana (anantha-l)
2017-06-23 22:26:52 Rick Dhiman juniperopenstack/r3.1: status New Incomplete
2017-06-23 22:26:57 Rick Dhiman juniperopenstack/r3.2: status New Incomplete
2017-06-23 22:27:00 Rick Dhiman juniperopenstack/r4.0: status New Incomplete
2017-06-23 22:27:02 Rick Dhiman juniperopenstack/trunk: status New Incomplete
2017-06-23 22:27:21 Jeba Paulaiyan juniperopenstack/r3.1: assignee Ananth Suryanarayana (anantha-l) kalagesan (kalagesan)
2017-06-30 04:49:59 Jeba Paulaiyan juniperopenstack/r3.1: milestone r3.1.3.0 r3.1.4.0
2017-07-10 07:53:08 Jeba Paulaiyan juniperopenstack/r3.2: milestone r3.2.3.0 r3.2.4.0
2017-07-17 22:38:50 Jeba Paulaiyan juniperopenstack/r3.2: milestone r3.2.4.0 r3.2.5.0
2017-07-18 18:24:40 Ananth Suryanarayana juniperopenstack/r3.2: assignee Ananth Suryanarayana (anantha-l) kalagesan (kalagesan)
2017-07-18 18:24:50 Ananth Suryanarayana juniperopenstack/r4.0: assignee Ananth Suryanarayana (anantha-l) kalagesan (kalagesan)
2017-07-18 18:25:01 Ananth Suryanarayana juniperopenstack/trunk: assignee Ananth Suryanarayana (anantha-l) kalagesan (kalagesan)
2017-08-03 00:30:10 Jeba Paulaiyan juniperopenstack/r3.1: status Incomplete Invalid
2017-08-03 00:30:14 Jeba Paulaiyan juniperopenstack/r4.0: status Incomplete Invalid
2017-08-03 00:30:17 Jeba Paulaiyan juniperopenstack/trunk: status Incomplete Invalid
2017-08-03 00:30:19 Jeba Paulaiyan juniperopenstack/r3.2: status Incomplete Invalid
2017-10-17 00:19:29 vivekananda shenoy juniperopenstack/r3.1: status Invalid New
2018-02-15 05:35:09 vivekananda shenoy juniperopenstack/r3.2: status Invalid New