[R5.0-k8s] Ping between pods on different compute fails

[Pulkit Tandon]

Configuration:
K8s 1.9.2
contrail-5.0.0-50
Centos-7.4

Setup:
5 node setup.
3 Kube manager. 3 Controller. 1 k8s master
2 Agent+ K8s slaves

Description:
Pod on 1 compute/k8s slave cannot ping to pod of other compute node.
Flows are correct on both the compute nodes.
Both Forward and revers flow are present with Action as "F"
Problem is with RPF_Nexthop

[root@nodec60 /]# flow -l
Flow table(size 80609280, entries 629760)

Entries: Created 3 Added 3 Deleted 4 Changed 6Processed 3 Used Overflow entries 0
(Created Flows/CPU: 0 0 0 3)(oflows 0)

Action:F=Forward, D=Drop N=NAT(S=SNAT, D=DNAT, Ps=SPAT, Pd=DPAT, L=Link Local Port)
 Other:K(nh)=Key_Nexthop, S(nh)=RPF_Nexthop
 Flags:E=Evicted, Ec=Evict Candidate, N=New Flow, M=Modified Dm=Delete Marked
TCP(r=reverse):S=SYN, F=FIN, R=RST, C=HalfClose, E=Established, D=Dead

    Index Source:Port/Destination:Port Proto(V)
-----------------------------------------------------------------------------------
   397940<=>426916 10.47.255.250:21764 1 (2)
                         10.47.255.249:0
(Gen: 19, K(nh):28, Action:F, Flags:, QOS:-1, S(nh):43, Stats:25/2100,
 SPort 52771, TTL 0, Sinfo 77.77.1.31)

   426916<=>397940 10.47.255.249:21764 1 (2)
                         10.47.255.250:0
(Gen: 19, K(nh):28, Action:F, Flags:, QOS:-1, S(nh):28, Stats:25/2450,
 SPort 54199, TTL 0, Sinfo 4.0.0.0)

[root@nodec60 /]#
[root@nodec60 /]# nh --get 43
vRouter(Response): No such file or directory (2)
[root@nodec60 /]# nh --get 28
Id:28 Type:Encap Fmly: AF_INET Rid:0 Ref_cnt:6 Vrf:2
              Flags:Valid, Policy, Etree Root,
              EncapFmly:0806 Oif:4 Len:14
              Encap Data: 02 ca bf 08 f2 38 00 00 5e 00 01 00 08 00

[root@nodec60 /]# nh --get 43