DPDK: Pkts with size greater that 1500 geting dropped

Bug #1573901 reported by Vinod Nair
16
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
New
High
Kiran
R3.2
New
High
Kiran
R3.2.3.x
New
High
Kiran
R4.0
New
High
Kiran
Trunk
New
High
Kiran

Bug Description

Large pkts > 1500 Bytes is getting dropped .. The pkt is seen in the vif but is not seen in the VM
SYSCALLS is getting incremented on the VF

root@cs-scale-7:~# vif --get 27
Vrouter Interface Table

Flags: P=Policy, X=Cross Connect, S=Service Chain, Mr=Receive Mirror
       Mt=Transmit Mirror, Tc=Transmit Checksum Offload, L3=Layer 3, L2=Layer 2
       D=DHCP, Vp=Vhost Physical, Pr=Promiscuous, Vnt=Native Vlan Tagged
       Mnp=No MAC Proxy, Dpdk=DPDK PMD Interface, Rfl=Receive Filtering Offload, Mon=Interface is Monitored
       Uuf=Unknown Unicast Flood, Vof=VLAN insert/strip offload

vif0/27 PMD: tap491b1e31-d8
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:0
            Vrf:10 Flags:PL3L2D MTU:9160 Ref:17
            RX port packets:39007 errors:0 syscalls:1
            RX queue packets:39005 errors:0
            RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
            RX packets:39007 bytes:9400775 errors:0
            TX packets:39761 bytes:11071122 errors:0
            TX port packets:39719 errors:42 syscalls:39719

   root@cs-scale-7:~#
root@cs-scale-7:~# vifdump 27 -xxx -e
tcpdump: WARNING: mon27: no IPv4 address assigned
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on mon27, link-type EN10MB (Ethernet), capture size 65535 bytes
22:35:32.072851 00:00:5e:00:01:00 (oui Unknown) > 02:d2:95:cd:c0:85 (oui Unknown), ethertype IPv4 (0x0800), length 2042: 41.0.0.254 > 145.3.0.7: ICMP echo request, id 61, seq 1, length 2008
        0x0000: 02d2 95cd c085 0000 5e00 0100 0800 4500
        0x0010: 07ec 231c 0000 4001 94ed 2900 00fe 9103
        0x0020: 0007 0800 ddb8 003d 0001 571a eda3 000b
        0x0030: 9d27 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0040: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0050: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0060: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0070: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0080: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0090: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x00a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x00b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x00c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x00d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x00e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x00f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0100: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0110: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0120: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0130: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0140: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0150: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0160: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0170: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0180: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0190: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x01a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x01b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x01c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x01d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x01e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x01f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0200: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0210: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0220: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0230: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0240: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0250: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0260: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0270: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0280: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0290: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x02a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x02b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x02c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x02d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x02e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x02f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0300: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0310: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0320: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0330: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0340: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0350: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0360: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0370: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0380: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0390: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x03a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x03b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x03c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x03d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x03e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x03f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0400: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0410: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0420: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0430: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0440: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0450: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0460: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0470: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0480: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0490: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x04a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x04b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x04c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x04d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x04e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x04f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0500: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0510: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0520: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0530: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0540: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0550: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0560: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0570: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0580: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0590: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x05a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x05b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x05c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x05d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x05e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x05f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0600: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0610: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0620: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0630: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0640: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0650: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0660: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0670: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0680: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0690: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x06a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x06b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x06c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x06d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x06e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x06f0: c6c7 c8c9 cacb cccd cecf d0d1 d2d3 d4d5
        0x0700: d6d7 d8d9 dadb dcdd dedf e0e1 e2e3 e4e5
        0x0710: e6e7 e8e9 eaeb eced eeef f0f1 f2f3 f4f5
        0x0720: f6f7 f8f9 fafb fcfd feff 0001 0203 0405
        0x0730: 0607 0809 0a0b 0c0d 0e0f 1011 1213 1415
        0x0740: 1617 1819 1a1b 1c1d 1e1f 2021 2223 2425
        0x0750: 2627 2829 2a2b 2c2d 2e2f 3031 3233 3435
        0x0760: 3637 3839 3a3b 3c3d 3e3f 4041 4243 4445
        0x0770: 4647 4849 4a4b 4c4d 4e4f 5051 5253 5455
        0x0780: 5657 5859 5a5b 5c5d 5e5f 6061 6263 6465
        0x0790: 6667 6869 6a6b 6c6d 6e6f 7071 7273 7475
        0x07a0: 7677 7879 7a7b 7c7d 7e7f 8081 8283 8485
        0x07b0: 8687 8889 8a8b 8c8d 8e8f 9091 9293 9495
        0x07c0: 9697 9899 9a9b 9c9d 9e9f a0a1 a2a3 a4a5
        0x07d0: a6a7 a8a9 aaab acad aeaf b0b1 b2b3 b4b5
        0x07e0: b6b7 b8b9 babb bcbd bebf c0c1 c2c3 c4c5
        0x07f0: c6c7 c8c9 cacb cccd cecf

1 packet captured
1 packet received by filter
0 packets dropped by kernel
vifdump: deleting vif 4324...
root@cs-scale-7:~# vif --get 27
Vrouter Interface Table

Flags: P=Policy, X=Cross Connect, S=Service Chain, Mr=Receive Mirror
       Mt=Transmit Mirror, Tc=Transmit Checksum Offload, L3=Layer 3, L2=Layer 2
       D=DHCP, Vp=Vhost Physical, Pr=Promiscuous, Vnt=Native Vlan Tagged
       Mnp=No MAC Proxy, Dpdk=DPDK PMD Interface, Rfl=Receive Filtering Offload, Mon=Interface is Monitored
       Uuf=Unknown Unicast Flood, Vof=VLAN insert/strip offload

vif0/27 PMD: tap491b1e31-d8
            Type:Virtual HWaddr:00:00:5e:00:01:00 IPaddr:0
            Vrf:10 Flags:PL3L2D MTU:9160 Ref:17
            RX port packets:39007 errors:0 syscalls:1
            RX queue packets:39005 errors:0
            RX queue errors to lcore 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
            RX packets:39007 bytes:9400775 errors:0
            TX packets:39763 bytes:11075206 errors:0
            TX port packets:39721 errors:42 syscalls:39721

MTU from the Compute to the Gateway is 9K

root@cs-scale-7:~#
root@cs-scale-7:~# tracepath 13.1.0.254
 1?: [LOCALHOST] pmtu 9000
 1: no reply
 2: 13.1.0.254 6.008ms reached
     Resume: pmtu 9000 hops 2 back 2
root@cs-scale-7:~#

BUILD: 3.0.2.0-32~kilo

Vinod Nair (vinodnair)
summary: - DPDK: Pkts with mtu greaterthat 1500 geting dropped
+ DPDK: Pkts with size greater that 1500 geting dropped
Vinod Nair (vinodnair)
description: updated
description: updated
Jeba Paulaiyan (jebap)
information type: Proprietary → Public
tags: added: blocker
Revision history for this message
Raja Sivaramakrishnan (raja-u) wrote :

Release note: When the underlay has jumbo MTU, setting jumbo MTU inside VMs will result in packets getting dropped.

tags: removed: blocker
Revision history for this message
Jeba Paulaiyan (jebap) wrote :

Release notes: Jumbo MTU setting inside a non-DPDK VMs running on a DPDK compute is not supported. This will lead to packets getting dropped.

tags: added: releasenote
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.