mm:overcommit_memory03 in ubuntu_ltp failed on Azure Standard_B1ms and AWS a1.medium (FAIL: alloc passed, expected to fail)

[Po-Hsu Lin]

This issue can be found solely on Focal Azure Standard_B1ms instance with
  * 5.4.0-1129.136 in sru-20240401 (passed after retest)
  * 5.4.0-1127.134 in sru-20240304
  * 5.15.0-1056.64~20.04.1 in sru-20240108

It seems this test is flaky on this instance as it's not failing constantly, passed with:
  * 5.15.0-1055.63~20.04.1 in sru-20240108
  * 5.4.0-1123.130 in sru-20240108
  * 5.4.0-1125.132 in sru-20240205
  * 5.15.0-1058.66~20.04.2 in sru-20240205
  * 5.15.0-1060.69~20.04.1 in sru-20240304

Test failed with:
  TFAIL: alloc passed, expected to fail

Test log:
INFO: Test start time: Mon Apr 15 04:15:40 UTC 2024
COMMAND: /opt/ltp/bin/ltp-pan -q -e -S -a 299223 -n 299223 -f /tmp/ltp-VSBcDQWRn1/alltests -l /dev/null -C /dev/null -T /dev/null
LOG File: /dev/null
FAILED COMMAND File: /dev/null
TCONF COMMAND File: /dev/null
Running tests.......
tst_kernel.c:88: TINFO: uname.machine=x86_64 kernel is 64bit
tst_test.c:1741: TINFO: LTP version: 20230929-407-g58aa31f55
tst_test.c:1625: TINFO: Timeout per run is 0h 00m 30s
overcommit_memory.c:99: TINFO: MemTotal is 1953340 kB
overcommit_memory.c:101: TINFO: SwapTotal is 0 kB
overcommit_memory.c:105: TINFO: CommitLimit is 976668 kB
mem.c:646: TINFO: set overcommit_ratio to 30
overcommit_memory.c:121: TINFO: TotalBatchSize is 7628 kB
mem.c:646: TINFO: set overcommit_memory to 2
overcommit_memory.c:157: TINFO: malloc 1992 kB successfully
overcommit_memory.c:184: TFAIL: alloc passed, expected to fail
overcommit_memory.c:161: TINFO: malloc 593628 kB failed
overcommit_memory.c:182: TPASS: alloc failed as expected
overcommit_memory.c:210: TINFO: CommitLimit is 586000, Committed_AS is 586852
overcommit_memory.c:218: TCONF: Specified overcommit_ratio 30 <= default 50, so it's possible for CommitLimit < Committed_AS and skip test

Summary:
passed 1
failed 1
broken 0
skipped 1
warnings 0
INFO: ltp-pan reported some tests FAIL
LTP Version: 20230929-407-g58aa31f55
INFO: Test end time: Mon Apr 15 04:15:40 UTC 2024

[1] https://lists.ubuntu.com/archives/kernel-team/2024-March/149664.html

[Po-Hsu Lin (cypressyew)]

This issue can be found on AWS ARM64 a1.medium with J-aws-5.15.0-1065.71 as well.

INFO: Test start time: Tue Jul 9 09:07:29 UTC 2024
COMMAND: /opt/ltp/bin/ltp-pan -q -e -S -a 156335 -n 156335 -f /tmp/ltp-GsuhfYWpUX/alltests -l /dev/null -C /dev/null -T /dev/null
LOG File: /dev/null
FAILED COMMAND File: /dev/null
TCONF COMMAND File: /dev/null
Running tests.......
tst_kernel.c:90: TINFO: uname.machine=aarch64 kernel is 64bit
tst_test.c:1733: TINFO: LTP version: 20230929-609-g3fc2d1b15
tst_test.c:1617: TINFO: Timeout per run is 0h 00m 30s
overcommit_memory.c:99: TINFO: MemTotal is 1850796 kB
overcommit_memory.c:101: TINFO: SwapTotal is 0 kB
overcommit_memory.c:105: TINFO: CommitLimit is 925396 kB
mem.c:646: TINFO: set overcommit_ratio to 30
overcommit_memory.c:121: TINFO: TotalBatchSize is 7228 kB
mem.c:646: TINFO: set overcommit_memory to 2
overcommit_memory.c:157: TINFO: malloc 2224 kB successfully
overcommit_memory.c:184: TFAIL: alloc passed, expected to fail
overcommit_memory.c:161: TINFO: malloc 562464 kB failed
overcommit_memory.c:182: TPASS: alloc failed as expected
overcommit_memory.c:157: TINFO: malloc 556 kB successfully
overcommit_memory.c:176: TPASS: alloc passed as expected
mem.c:646: TINFO: set overcommit_memory to 0
overcommit_memory.c:157: TINFO: malloc 663350 kB successfully
overcommit_memory.c:176: TPASS: alloc passed as expected
overcommit_memory.c:161: TINFO: malloc 3701592 kB failed
overcommit_memory.c:182: TPASS: alloc failed as expected
mem.c:646: TINFO: set overcommit_memory to 1
overcommit_memory.c:157: TINFO: malloc 925398 kB successfully
overcommit_memory.c:176: TPASS: alloc passed as expected
overcommit_memory.c:157: TINFO: malloc 1850796 kB successfully
overcommit_memory.c:176: TPASS: alloc passed as expected
overcommit_memory.c:157: TINFO: malloc 3701592 kB successfully
overcommit_memory.c:176: TPASS: alloc passed as expected

Summary:
passed 7
failed 1
broken 0
skipped 0
warnings 0
INFO: ltp-pan reported some tests FAIL
LTP Version: 20230929-609-g3fc2d1b15
INFO: Test end time: Tue Jul 9 09:07:29 UTC 2024

I think it's because this is a rather small instance as well.