test_verifier in ubuntu_bpf failed with 41 test cases on J-ARM64 openstack

[Po-Hsu Lin]

Issue found with J-generic-5.15.0-88.98 and J-lowlatency-5.15.0-88.98 on Openstack ARM64 instance.

After the ubuntu_bpf build issue (bug 2035181) fixed, test in ubuntu_bpf can be tested and reporting failures:
 #21/u BPF_ATOMIC_AND without fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 35 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #21/p BPF_ATOMIC_AND without fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 27 usec
 stack depth 8
 processed 10 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #22/u BPF_ATOMIC_AND with fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 84 usec
 stack depth 8
 processed 16 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #22/p BPF_ATOMIC_AND with fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 29 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #23/u BPF_ATOMIC_AND with fetch 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 59 usec
 stack depth 4
 processed 14 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #23/p BPF_ATOMIC_AND with fetch 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 47 usec
 stack depth 4
 processed 14 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #24/u BPF_ATOMIC_AND with fetch - r0 as source reg FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 34 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #24/p BPF_ATOMIC_AND with fetch - r0 as source reg FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 35 usec
 stack depth 8
 processed 10 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0
 #25/p BPF_ATOMIC bounds propagation, mem->reg FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 18 usec
 stack depth 8
 processed 6 insns (limit 1000000) max_states_per_insn 0 total_states 0 peak_states 0 mark_read 0
 #26/u atomic compare-and-exchange smoketest - 64bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 48 usec
 stack depth 8
 processed 23 insns (limit 1000000) max_states_per_insn 0 total_states 2 peak_states 2 mark_read 1
 #26/p atomic compare-and-exchange smoketest - 64bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 37 usec
 stack depth 8
 processed 21 insns (limit 1000000) max_states_per_insn 0 total_states 2 peak_states 2 mark_read 1
 #27/u atomic compare-and-exchange smoketest - 32bit FAIL
 Unexpected verifier log!
 EXP: R0 leaks addr into mem
 RES:
 FAIL
 Unexpected error message!
     EXP: R0 leaks addr into mem
     RES: verification time 96 usec
 stack depth 4
 processed 23 insns (limit 1000000) max_states_per_insn 0 total_states 2 peak_states 2 mark_read 1

 verification time 96 usec
 stack depth 4
 processed 23 insns (limit 1000000) max_states_per_insn 0 total_states 2 peak_states 2 mark_read 1
 #27/p atomic compare-and-exchange smoketest - 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 62 usec
 stack depth 4
 processed 23 insns (limit 1000000) max_states_per_insn 0 total_states 2 peak_states 2 mark_read 1
 #30/u BPF_W cmpxchg should zero top 32 bits FAIL
 Unexpected verifier log!
 EXP: R0 leaks addr into mem
 RES:
 FAIL
 Unexpected error message!
     EXP: R0 leaks addr into mem
     RES: verification time 50 usec
 stack depth 8
 processed 13 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0

 verification time 50 usec
 stack depth 8
 processed 13 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0
 #30/p BPF_W cmpxchg should zero top 32 bits FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 33 usec
 stack depth 8
 processed 13 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0
 #31/p Dest pointer in r0 - succeed, check 2 FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 18 usec
 stack depth 8
 processed 7 insns (limit 1000000) max_states_per_insn 0 total_states 0 peak_states 0 mark_read 0
 #33/p Dest pointer in r0 - succeed, check 4 FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 32 usec
 stack depth 8
 processed 7 insns (limit 1000000) max_states_per_insn 0 total_states 0 peak_states 0 mark_read 0
 #35/u BPF_ATOMIC_FETCH_ADD smoketest - 64bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 34 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #35/p BPF_ATOMIC_FETCH_ADD smoketest - 64bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 29 usec
 stack depth 8
 processed 10 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #36/u BPF_ATOMIC_FETCH_ADD smoketest - 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 37 usec
 stack depth 4
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #36/p BPF_ATOMIC_FETCH_ADD smoketest - 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 36 usec
 stack depth 4
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #41/u BPF_ATOMIC OR without fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 36 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #41/p BPF_ATOMIC OR without fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 26 usec
 stack depth 8
 processed 10 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #42/u BPF_ATOMIC OR with fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 30 usec
 stack depth 8
 processed 16 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #42/p BPF_ATOMIC OR with fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 31 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #43/u BPF_ATOMIC OR with fetch 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 47 usec
 stack depth 4
 processed 14 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #43/p BPF_ATOMIC OR with fetch 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 41 usec
 stack depth 4
 processed 14 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #44/u BPF_W atomic_fetch_or should zero top 32 bits FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 47 usec
 stack depth 8
 processed 13 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0
 #44/p BPF_W atomic_fetch_or should zero top 32 bits FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 31 usec
 stack depth 8
 processed 13 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0
 #45/u atomic exchange smoketest - 64bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 32 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #45/p atomic exchange smoketest - 64bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 50 usec
 stack depth 8
 processed 10 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 0
 #46/u atomic exchange smoketest - 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 41 usec
 stack depth 4
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #46/p atomic exchange smoketest - 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 38 usec
 stack depth 4
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #47/u BPF_ATOMIC XOR without fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 33 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #47/p BPF_ATOMIC XOR without fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 27 usec
 stack depth 8
 processed 10 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #48/u BPF_ATOMIC XOR with fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 35 usec
 stack depth 8
 processed 16 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #48/p BPF_ATOMIC XOR with fetch FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 27 usec
 stack depth 8
 processed 12 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #49/u BPF_ATOMIC XOR with fetch 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 44 usec
 stack depth 4
 processed 14 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #49/p BPF_ATOMIC XOR with fetch 32bit FAIL
 Failed to load prog 'Unknown error 524'!
 verification time 43 usec
 stack depth 4
 processed 14 insns (limit 1000000) max_states_per_insn 0 total_states 1 peak_states 1 mark_read 1
 #150/p calls: trigger reg2btf_ids[reg->type] for reg->type > __BPF_REG_TYPE_MAX FAIL
 Unexpected verifier log!
 EXP: arg#0 pointer type STRUCT prog_test_ref_kfunc must point
 RES:
 FAIL
 Unexpected error message!
     EXP: arg#0 pointer type STRUCT prog_test_ref_kfunc must point
     RES: JIT does not support calling kernel function
 verification time 7 usec
 stack depth 0
 processed 0 insns (limit 1000000) max_states_per_insn 0 total_states 0 peak_states 0 mark_read 0

 JIT does not support calling kernel function
 verification time 7 usec
 stack depth 0
 processed 0 insns (limit 1000000) max_states_per_insn 0 total_states 0 peak_states 0 mark_read 0
 #797/p precise: ST insn causing spi > allocated_stack FAIL
 Unexpected verifier log!
 EXP: parent didn't have regs=10 stack=0 marks
 RES:
 func#0 @0
 0: R1=ctx(id=0,off=0,imm=0) R10=fp0
 0: (bf) r3 = r10
 1: R1=ctx(id=0,off=0,imm=0) R3=fp0 R10=fp0
 1: (55) if r3 != 0x7b goto pc+0
  R1=ctx(id=0,off=0,imm=0) R3=fp0 R10=fp0
 2: R1=ctx(id=0,off=0,imm=0) R3=fp0 R10=fp0
 2: (7a) *(u64 *)(r3 -8) = 0
 3: R1=ctx(id=0,off=0,imm=0) R3=fp0 R10=fp0 fp-8_w=00000000
 3: (79) r4 = *(u64 *)(r10 -8)
 4: R1=ctx(id=0,off=0,imm=0) R3=fp0 R4_w=invP0 R10=fp0 fp-8_w=00000000
 4: (b7) r0 = -1
 5: R0=inv-1 R1=ctx(id=0,off=0,imm=0) R3=fp0 R4=invP0 R10=fp0 fp-8=00000000
 5: (2d) if r4 > r0 goto pc+0
 last_idx 5 first_idx 5
  R0_rw=invP-1 R1=ctx(id=0,off=0,imm=0) R3=fp0 R4_rw=invP0 R10=fp0 fp-8_w=00000000
 parent didn't have regs=1 stack=0 marks
 last_idx 4 first_idx 2
 regs=1 stack=0 before 4: (b7) r0 = -1
 6: R0=invP-1 R1=ctx(id=0,off=0,imm=0) R3=fp0 R4=invP0 R10=fp0 fp-8=00000000
 6: (95) exit

 from 1 to 2: safe
 processed 8 insns (limit 1000000) max_states_per_insn 0 total_states 4 peak_states 4 mark_read 1

This should not be considered as a regression since we just start testing ubuntu_bpf on openstack instances from 5.15.0-83 (and it's affected by the aforementioned build issue since then)

We used to have bug 1991215, but I decided to open a new one as that report is quite old.