rtnetlink.sh in net from ubuntu_kernel_selftests fails

[Po-Hsu Lin]

There are several failures in this test:
  * ipv6 addrlabel
  * macsec
  * ipsec

$ sudo ./rtnetlink.sh
PASS: policy routing
PASS: route get
PASS: tc htb hierarchy
PASS: gre tunnel endpoint
PASS: gretap
PASS: ip6gretap
PASS: erspan
PASS: ip6erspan
PASS: bridge setup
FAIL: ipv6 addrlabel
PASS: set ifalias 485dc5aa-b024-4952-88a7-414355fc2bdc for test-dummy0
PASS: vrf
PASS: vxlan
FAIL: can't add fou port 7777, skipping test
*** stack smashing detected ***: <unknown> terminated
./rtnetlink.sh: line 468: 5132 Aborted (core dumped) ip macsec show > /dev/null
FAIL: macsec
./rtnetlink.sh: line 527: 5146 Terminated ip x m > $tmpfile
FAIL: ipsec

ProblemType: Bug
DistroRelease: Ubuntu 18.10
Package: linux-image-4.18.0-14-generic 4.18.0-14.15
ProcVersionSignature: User Name 4.18.0-14.15-generic 4.18.20
Uname: Linux 4.18.0-14-generic x86_64
AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116, 1 Jan 23 09:53 seq
 crw-rw---- 1 root audio 116, 33 Jan 23 09:53 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay': 'aplay'
ApportVersion: 2.20.10-0ubuntu13.1
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord': 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
Date: Wed Jan 23 10:01:23 2019
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig': 'iwconfig'
MachineType: Intel Corporation S1200RP
PciMultimedia:

ProcFB: 0 mgadrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.18.0-14-generic root=UUID=b0d2ae4e-12dd-423e-acea-272ee8b2a893 ro console=ttyS0,115200n8
RelatedPackageVersions:
 linux-restricted-modules-4.18.0-14-generic N/A
 linux-backports-modules-4.18.0-14-generic N/A
 linux-firmware 1.175.1
RfKill: Error: [Errno 2] No such file or directory: 'rfkill': 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 07/01/2015
dmi.bios.vendor: Intel Corp.
dmi.bios.version: S1200RP.86B.03.02.0003.070120151022
dmi.board.asset.tag: ....................
dmi.board.name: S1200RP
dmi.board.vendor: Intel Corporation
dmi.board.version: G62254-407
dmi.chassis.asset.tag: ....................
dmi.chassis.type: 17
dmi.chassis.vendor: ..............................
dmi.chassis.version: ..................
dmi.modalias: dmi:bvnIntelCorp.:bvrS1200RP.86B.03.02.0003.070120151022:bd07/01/2015:svnIntelCorporation:pnS1200RP:pvr....................:rvnIntelCorporation:rnS1200RP:rvrG62254-407:cvn..............................:ct17:cvr..................:
dmi.product.family: To be filled by O.E.M.
dmi.product.name: S1200RP
dmi.product.sku: To be filled by O.E.M.
dmi.product.version: ....................
dmi.sys.vendor: Intel Corporation

[Po-Hsu Lin (cypressyew)]

This test has passed on B-hwe, with some syntax error:
 selftests: net: rtnetlink.sh
 ========================================
 PASS: policy routing
 PASS: route get
 PASS: tc htb hierarchy
 PASS: gre tunnel endpoint
 PASS: gretap
 Usage: ... { ip6gre | ip6gretap | ip6erspan} [ remote ADDR ]
 [ local ADDR ]
 [ [i|o]seq ]
 [ [i|o]key KEY ]
 [ [i|o]csum ]
 [ hoplimit TTL ]
 [ encaplimit ELIM ]
 [ tclass TCLASS ]
 [ flowlabel FLOWLABEL ]
 [ dscp inherit ]
 [ fwmark MARK ]
 [ dev PHYS_DEV ]
 [ noencap ]
 [ encap { fou | gue | none } ]
 [ encap-sport PORT ]
 [ encap-dport PORT ]
 [ [no]encap-csum ]
 [ [no]encap-csum6 ]
 [ [no]encap-remcsum ]
 [ erspan IDX ]

 Where: ADDR := IPV6_ADDRESS
 TTL := { 0..255 } (default=64)
 KEY := { DOTTED_QUAD | NUMBER }
 ELIM := { none | 0..255 }(default=4)
 TCLASS := { 0x0..0xff | inherit }
 FLOWLABEL := { 0x0..0xfffff | inherit }
 MARK := { 0x0..0xffffffff | inherit }
 Cannot find device "ip6gretap00"
 FAIL: ip6gretap
 Usage: ... { gre | gretap | erspan } [ remote ADDR ]
 [ local ADDR ]
 [ [i|o]seq ]
 [ [i|o]key KEY ]
 [ [i|o]csum ]
 [ ttl TTL ]
 [ tos TOS ]
 [ [no]pmtudisc ]
 [ [no]ignore-df ]
 [ dev PHYS_DEV ]
 [ noencap ]
 [ encap { fou | gue | none } ]
 [ encap-sport PORT ]
 [ encap-dport PORT ]
 [ [no]encap-csum ]
 [ [no]encap-csum6 ]
 [ [no]encap-remcsum ]
 [ external ]
 [ fwmark MARK ]
 [ erspan IDX ]

 Where: ADDR := { IP_ADDRESS | any }
 TOS := { NUMBER | inherit }
 TTL := { 1..255 | inherit }
 KEY := { DOTTED_QUAD | NUMBER }
 MARK := { 0x0..0xffffffff }
 Cannot find device "erspan00"
 Cannot find device "erspan00"
 Cannot find device "erspan00"
 Usage: ... { gre | gretap | erspan } [ remote ADDR ]
 [ local ADDR ]
 [ [i|o]seq ]
 [ [i|o]key KEY ]
 [ [i|o]csum ]
 [ ttl TTL ]
 [ tos TOS ]
 [ [no]pmtudisc ]
 [ [no]ignore-df ]
 [ dev PHYS_DEV ]
 [ noencap ]
 [ encap { fou | gue | none } ]
 [ encap-sport PORT ]
 [ encap-dport PORT ]
 [ [no]encap-csum ]
 [ [no]encap-csum6 ]
 [ [no]encap-remcsum ]
 [ external ]
 [ fwmark MARK ]
 [ erspan IDX ]

 Where: ADDR := { IP_ADDRESS | any }
 TOS := { NUMBER | inherit }
 TTL := { 1..255 | inherit }
 KEY := { DOTTED_QUAD | NUMBER }
 MARK := { 0x0..0xffffffff }
 Cannot find device "erspan00"
 Cannot find device "erspan00"
 Cannot find device "erspan00"
 FAIL: erspan
 Usage: ... { ip6gre | ip6gretap | ip6erspan} [ remote ADDR ]
 [ local ADDR ]
 [ [i|o]seq ]
 [ [i|o]key KEY ]
 [ [i|o]csum ]
 [ hoplimit TTL ]
 [ encaplimit ELIM ]
 [ tclass TCLASS ]
 [ flowlabel FLOWLABEL ]
 [ dscp inherit ]
 [ fwmark MARK ]
 [ dev PHYS_DEV ]
 [ noencap ]
 [ encap { fou | gue | none } ]
 [ encap-sport PORT ]
 [ encap-dport PORT ]
 [ [no]encap-csum ]
 [ [no]encap-csum6 ]
 [ [no]encap-remcsum ]
 [ erspan IDX ]

 Where: ADDR := IPV6_ADDRESS
 TTL := { 0..255 } (default=64)
 KEY := { DOTTED_QUAD | NUMBER }
 ELIM := { none | 0..255 }(default=4)
 TCLASS := { 0x0..0xff | inherit }
 FLOWLABEL := { 0x0..0xfffff | inherit }
 MARK := { 0x0..0xffffffff | inherit }
 Cannot find device "ip6erspan00"
 Cannot find device "ip6erspan00"
 Cannot find device "ip6erspan00"
 Usage: ... { ip6gre | ip6gretap | ip6erspan} [ remote ADDR ]
 [ local ADDR ]
 [ [i|o]seq ]
 [ [i|o]key KEY ]
 [ [i|o]csum ]
 [ hoplimit TTL ]
 [ en...

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This change was made by a bot.

[Sean Feole (sfeole)]

I'm seeing similar , possibly related failures on Bionic linux-aws, 4.15.0-1040.42,
I'm going to start consolidating this bug to track these failures on the various clouds.

05/20 17:49:07 DEBUG| utils:0153| [stdout] ========================================
05/20 17:49:09 DEBUG| utils:0153| [stdout] test_bpf: ok
05/20 17:49:09 DEBUG| utils:0153| [stdout] ok 1..8 selftests: test_bpf.sh [PASS]
05/20 17:49:09 DEBUG| utils:0153| [stdout] selftests: netdevice.sh
05/20 17:49:09 DEBUG| utils:0153| [stdout] ========================================
05/20 17:49:09 DEBUG| utils:0153| [stdout] SKIP: enp4s0: interface already up
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: enp4s0: ethtool list features
05/20 17:49:09 ERROR| utils:0153| [stderr] Cannot get register dump: Operation not supported
05/20 17:49:09 DEBUG| utils:0153| [stdout] SKIP: enp4s0: ethtool dump not supported
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: enp4s0: ethtool stats
05/20 17:49:09 DEBUG| utils:0153| [stdout] SKIP: enp4s0: interface kept up
05/20 17:49:09 DEBUG| utils:0153| [stdout] ok 1..9 selftests: netdevice.sh [PASS]
05/20 17:49:09 DEBUG| utils:0153| [stdout] selftests: rtnetlink.sh
05/20 17:49:09 DEBUG| utils:0153| [stdout] ========================================
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: policy routing
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: route get
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: tc htb hierarchy
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: gre tunnel endpoint
05/20 17:49:09 DEBUG| utils:0153| [stdout] PASS: bridge setup
05/20 17:49:11 DEBUG| utils:0153| [stdout] PASS: ipv6 addrlabel
05/20 17:49:11 DEBUG| utils:0153| [stdout] PASS: set ifalias 4488186b-9d9c-473a-89bc-29dba7fd5d44 for test-dummy0
05/20 17:49:11 ERROR| utils:0153| [stderr] RTNETLINK answers: Operation not supported
05/20 17:49:11 DEBUG| utils:0153| [stdout] FAIL: can't add vrf interface, skipping test
05/20 17:49:11 DEBUG| utils:0153| [stdout] PASS: vxlan
05/20 17:49:11 DEBUG| utils:0153| [stdout] FAIL: can't add fou port 7777, skipping test
05/20 17:49:11 ERROR| utils:0153| [stderr] RTNETLINK answers: Operation not supported
05/20 17:49:11 DEBUG| utils:0153| [stdout] FAIL: can't add macsec interface, skipping test
05/20 17:49:11 DEBUG| utils:0153| [stdout] not ok 1..10 selftests: rtnetlink.sh [FAIL]

[Po-Hsu Lin (cypressyew)]

Passed on Eoan (5.3.0-48.41):
 # selftests: net: rtnetlink.sh
 # PASS: policy routing
 # PASS: route get
 # PASS: preferred_lft addresses have expired
 # PASS: promote_secondaries complete
 # PASS: tc htb hierarchy
 # PASS: gre tunnel endpoint
 # PASS: gretap
 # PASS: ip6gretap
 # PASS: erspan
 # PASS: ip6erspan
 # PASS: bridge setup
 # PASS: ipv6 addrlabel
 # PASS: set ifalias 268cc6ee-d755-450a-bf54-432633518347 for test-dummy0
 # PASS: vrf
 # PASS: vxlan
 # FAIL: can't add fou port 7777, skipping test
 # PASS: macsec
 # PASS: ipsec
 # PASS: ipsec_offload
 # SKIP: fdb get tests: iproute2 too old
 # SKIP: fdb get tests: iproute2 too old
 ok 11 selftests: net: rtnetlink.sh

[Po-Hsu Lin (cypressyew)]

Issue found on 4.15.0-2006.7-azure-fips

[Po-Hsu Lin (cypressyew)]

For comment #6, install the module-extra package can solve this problem.

[Po-Hsu Lin (cypressyew)]

Checked on the following kernels, this is not failing anymore:
aws 5.4.0-1020.20~18.04.2-aws
aws 5.3.0-1032.34~18.04.1
aws 5.3.0-1032.34
aws 4.15.0-1079.83
aws-fips 4.15.0-2023.23
aws 4.15.0-1079.83~16.04.1
aws 4.4.0-1111.123
gcp 5.4.0-1021.21~18.04.1
gcp 5.3.0-1032.34~18.04.1
gke 5.3.0-1032.34~18.04.1
gke-generic 5.3.0-64.58~18.04.1
gke-generic 5.0.0-53.57~18.04.1
gcp 5.3.0-1032.34
gcp 4.15.0-1080.90

Therefore I am going to close this bug, please check for the kernel config first if you found this test is failing (see bug 1812194)

Commit to install modules-extra package for kselftest:
https://kernel.ubuntu.com/git/ubuntu/autotest-client-tests.git/commit/?id=386354240a98a62f8b346d01fc9674750efd97a0