Juniper Openstack

Gateway_less_Fwd: VMI route is not exported to BGP peering router when interface mirroring is configured on IP fabric provider networks

Bug #1718352 reported by Chandra Sekhar Reddy Mallam
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.1
Fix Committed
High
Naveen N
Juniper Openstack r4.1.0.0-fcs "r4.1"
Trunk
Fix Committed
High
Naveen N
Juniper Openstack r5.0.0

Bug Description

VMI route is not exported to BGP peering router when interface mirroring is configured on IP fabric provider networks

Build
------
R4.1.0.0 Build 54 Ubuntu 14.04.5 Mitaka

Steps
Configure 3 VNs (left-vn, right-vn, mirror-vn)
Configure IP Fabric VN as provider entwork for these VNs
Create end VMs (left_vm and right_vm) belonging to left_vn and right_vn and ananlyzer_vm belonging to mirror-vn on 3 different computes
Create a policy to allow traffic between left_vn and right_vn
Ping right_vm from left_vm and ping goes throug
Now, configure interface mirroring on left_vm VMI to mirror traffic to analyzer_vm
After step 7, original ping between left_vm and right_vm stops. VMI route is not exported to BGP peer router

root@nodek11:~# vif --list
Vrouter Interface Table

Flags: P=Policy, X=Cross Connect, S=Service Chain, Mr=Receive Mirror
       Mt=Transmit Mirror, Tc=Transmit Checksum Offload, L3=Layer 3, L2=Layer 2
       D=DHCP, Vp=Vhost Physical, Pr=Promiscuous, Vnt=Native Vlan Tagged
       Mnp=No MAC Proxy, Dpdk=DPDK PMD Interface, Rfl=Receive Filtering Offload, Mon=Interface is Monitored
       Uuf=Unknown Unicast Flood, Vof=VLAN insert/strip offload, Df=Drop New Flows, L=MAC Learning Enabled
       Proxy=MAC Requests Proxied Always, Er=Etree Root

vif0/0 OS: em1 (Speed 1000, Duplex 1)
            Type:Physical HWaddr:0c:c4:7a:32:0a:88 IPaddr:0.0.0.0
            Vrf:0 Flags:L3L2VpEr QOS:-1 Ref:6
            RX packets:2595 bytes:774465 errors:0
            TX packets:1025 bytes:935082 errors:0
            Drops:0

vif0/1 OS: vhost0
            Type:Host HWaddr:0c:c4:7a:32:0a:88 IPaddr:10.204.216.231
            Vrf:0 Flags:PL3DEr QOS:-1 Ref:7
            RX packets:984 bytes:930544 errors:0
            TX packets:2712 bytes:781763 errors:0
            Drops:1

vif0/2 OS: pkt0
            Type:Agent HWaddr:00:00:5e:00:01:00 IPaddr:0.0.0.0
            Vrf:65535 Flags:L3Er QOS:-1 Ref:3
            RX packets:861 bytes:80546 errors:0
            TX packets:1922 bytes:199997 errors:0
            Drops:0

vif0/3 OS: tapd6e7ab3f-d9
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:20.20.20.3
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:156 bytes:11940 errors:0
            TX packets:126 bytes:8592 errors:0
            Drops:50

vif0/4 OS: tap4c4c25d6-3c
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:20.20.20.5
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:141 bytes:12354 errors:0
            TX packets:202 bytes:11684 errors:0
            Drops:36

vif0/5 OS: tap6e69e64d-e9
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:30.30.30.3
            Vrf:9 Flags:PL3L2DEr QOS:-1 Ref:5
            RX packets:81 bytes:3402 errors:0
            TX packets:166 bytes:6972 errors:0
            Drops:4

vif0/6 OS: tap7bbf8a28-70
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:26.254.50.3
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:191 bytes:14942 errors:0
            TX packets:151 bytes:8062 errors:0
            Drops:4

vif0/7 OS: tap049391c2-59
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:10.10.10.5
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:77 bytes:3234 errors:0
            TX packets:170 bytes:7140 errors:0
            Drops:4

vif0/4350 OS: pkt3
            Type:Stats HWaddr:00:00:00:00:00:00 IPaddr:0.0.0.0
            Vrf:65535 Flags:L3L2 QOS:0 Ref:1
            RX packets:0 bytes:0 errors:0
            TX packets:0 bytes:0 errors:0
            Drops:0

vif0/4351 OS: pkt1
            Type:Stats HWaddr:00:00:00:00:00:00 IPaddr:0.0.0.0
            Vrf:65535 Flags:L3L2 QOS:0 Ref:1
            RX packets:0 bytes:0 errors:0
            TX packets:0 bytes:0 errors:0
            Drops:0

root@nodek11:~# rt --dump 0 | grep 77.217.63.3
77.217.63.3/32 32 PT - 14 80:ac:ac:f0:a2:c1(238756)
77.217.63.30/32 0 T - 14 -
77.217.63.31/32 0 T - 14 -
77.217.63.32/32 0 T - 14 -
77.217.63.33/32 0 T - 14 -
77.217.63.34/32 0 T - 14 -
77.217.63.35/32 0 T - 14 -
77.217.63.36/32 0 T - 14 -
77.217.63.37/32 0 T - 14 -
77.217.63.38/32 0 T - 14 -
77.217.63.39/32 0 T - 14 -
root@nodek11:~# nh --get 14
Id:14 Type:Encap Fmly: AF_INET Rid:0 Ref_cnt:6095 Vrf:0
              Flags:Valid, Etree Root,
              EncapFmly:0806 Oif:0 Len:14
              Encap Data: 80 ac ac f0 a2 c1 0c c4 7a 32 0a 88 08 00

root@nodek11:~#

$ ping 77.217.63.3
PING 77.217.63.3 (77.217.63.3): 56 data bytes
64 bytes from 77.217.63.3: seq=0 ttl=61 time=1.354 ms
64 bytes from 77.217.63.3: seq=1 ttl=61 time=0.593 ms
64 bytes from 77.217.63.3: seq=2 ttl=61 time=0.576 ms
^C
--- 77.217.63.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.576/0.841/1.354 ms
$

————————————————————————
Now, configuring interface mirroring on left_vm VMI
————————————————————————

root@nodek11:~# vif --list
Vrouter Interface Table

Flags: P=Policy, X=Cross Connect, S=Service Chain, Mr=Receive Mirror
       Mt=Transmit Mirror, Tc=Transmit Checksum Offload, L3=Layer 3, L2=Layer 2
       D=DHCP, Vp=Vhost Physical, Pr=Promiscuous, Vnt=Native Vlan Tagged
       Mnp=No MAC Proxy, Dpdk=DPDK PMD Interface, Rfl=Receive Filtering Offload, Mon=Interface is Monitored
       Uuf=Unknown Unicast Flood, Vof=VLAN insert/strip offload, Df=Drop New Flows, L=MAC Learning Enabled
       Proxy=MAC Requests Proxied Always, Er=Etree Root

vif0/0 OS: em1 (Speed 1000, Duplex 1)
            Type:Physical HWaddr:0c:c4:7a:32:0a:88 IPaddr:0.0.0.0
            Vrf:0 Flags:L3L2VpEr QOS:-1 Ref:6
            RX packets:2428 bytes:773010 errors:0
            TX packets:1292 bytes:999907 errors:0
            Drops:0

vif0/1 OS: vhost0
            Type:Host HWaddr:0c:c4:7a:32:0a:88 IPaddr:10.204.216.231
            Vrf:0 Flags:PL3DEr QOS:-1 Ref:7
            RX packets:874 bytes:940075 errors:0
            TX packets:2383 bytes:755080 errors:0
            Drops:1

vif0/2 OS: pkt0
            Type:Agent HWaddr:00:00:5e:00:01:00 IPaddr:0.0.0.0
            Vrf:65535 Flags:L3Er QOS:-1 Ref:3
            RX packets:756 bytes:70616 errors:0
            TX packets:1676 bytes:175561 errors:0
            Drops:63

vif0/3 OS: tapd6e7ab3f-d9
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:20.20.20.3
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:141 bytes:10944 errors:0
            TX packets:113 bytes:7746 errors:0
            Drops:48

vif0/4 OS: tap4c4c25d6-3c
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:20.20.20.5
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:119 bytes:10224 errors:0
            TX packets:176 bytes:9992 errors:0
            Drops:30

vif0/5 OS: tap6e69e64d-e9
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:30.30.30.3
            Vrf:9 Flags:PL3L2DEr QOS:-1 Ref:5
            RX packets:71 bytes:2982 errors:0
            TX packets:146 bytes:6132 errors:0
            Drops:4

vif0/6 OS: tap7bbf8a28-70
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:26.254.50.3 <==============
            Vrf:0 Flags:PMrMtL3L2DProxyEr QOS:-1 Ref:5 Mirror index 0
            RX packets:182 bytes:14060 errors:0
            TX packets:230 bytes:26604 errors:0
            Drops:7

vif0/7 OS: tap049391c2-59
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:10.10.10.5
            Vrf:0 Flags:PL3L2DProxyEr QOS:-1 Ref:5
            RX packets:67 bytes:2814 errors:0
            TX packets:150 bytes:6300 errors:0
            Drops:4

vif0/4350 OS: pkt3
            Type:Stats HWaddr:00:00:00:00:00:00 IPaddr:0.0.0.0
            Vrf:65535 Flags:L3L2 QOS:0 Ref:1
            RX packets:0 bytes:0 errors:0
            TX packets:0 bytes:0 errors:0
            Drops:0

vif0/4351 OS: pkt1
            Type:Stats HWaddr:00:00:00:00:00:00 IPaddr:0.0.0.0
            Vrf:65535 Flags:L3L2 QOS:0 Ref:1
            RX packets:0 bytes:0 errors:0
            TX packets:0 bytes:0 errors:0
            Drops:0

root@nodek11:~# mirror -b
Mirror Table

Flags:D=Dynamic Mirroring, Hw=NIC Assisted Mirroring

Index NextHop Flags VNI Vlan
------------------------------------------------
    0 27 D 0 0
root@nodek11:~# nh --get 27
Id:27 Type:Tunnel Fmly: AF_INET Rid:0 Ref_cnt:2 Vrf:-1
              Flags:Valid, Udp, Copy SIP, Etree Root,
              Oif:0 Len:14 Data:00 00 00 00 00 00 0c c4 7a 32 0a 88 08 00
              Sip:10.204.216.231 Dip:30.163.114.3
              Sport:8097 Dport:8099

root@nodek11:~#

$ ping 77.217.63.3
PING 77.217.63.3 (77.217.63.3): 56 data bytes
^C
--- 77.217.63.3 ping statistics ---
139 packets transmitted, 0 packets received, 100% packet loss
$

——————

EX BGP peer router

——————

root@sw166> show route receive-protocol bgp 10.204.217.127

inet.0: 88 destinations, 88 routes (84 active, 0 holddown, 4 hidden)
  Prefix Nexthop MED Lclpref AS path
* 10.10.10.3/32 10.204.216.2 200 100 ?
* 10.10.10.4/32 10.204.216.2 200 100 ?
* 10.10.10.5/32 10.204.216.231 200 100 ?
* 20.20.20.4/32 10.204.216.2 200 100 ?
* 30.163.114.3/32 10.204.216.2 200 100 ?
* 77.217.63.3/32 10.204.217.8 200 100 ?

{master:0}
root@sw166>

there is no route for left_vm VMI (26.254.50.3/32)

Tags: vrouter
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/35933
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/35939
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/35933
Committed: http://github.com/Juniper/contrail-controller/commit/4ea44878844e07fb0f948dd2369ff9eecf923a15
Submitter: Zuul (<email address hidden>)
Branch: master

commit 4ea44878844e07fb0f948dd2369ff9eecf923a15
Author: Naveen N <email address hidden>
Date: Tue Sep 26 11:26:52 2017 +0530

* Publish VM port peer route in ip-fabric VRF

Due to merge conflict currently only local peer port routes
were exported in ip-fabric, correcting the same.

Change-Id: I0145e29e35a572fc2d0c3cd1e3b6b9988142804f
Closes-bug: #1718352

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/35939
Committed: http://github.com/Juniper/contrail-controller/commit/b4991276b445dda76b641de83ddb5232f03d6ffd
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit b4991276b445dda76b641de83ddb5232f03d6ffd
Author: Naveen N <email address hidden>
Date: Tue Sep 26 11:26:52 2017 +0530

* Publish VM port peer route in ip-fabric VRF

Due to merge conflict currently only local peer port routes
were exported in ip-fabric, correcting the same.

Change-Id: I0145e29e35a572fc2d0c3cd1e3b6b9988142804f
Closes-bug: #1718352

Nischal Sheth (nsheth)
information type: Proprietary → Public
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.