linux-hwe 4.8.0-42.45~16.04.1 ADT test failure with linux-hwe 4.8.0-42.45~16.04.1

[Andy Whitcroft]

Testing failed on:
    ppc64el: https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-xenial/xenial/ppc64el/l/linux-hwe/20170310_182342_193aa@/log.gz

[Andy Whitcroft (apw)]

18:23:15 DEBUG| Running '/tmp/autopkgtest.RPzCMT/build.9Xr/linux-hwe-4.8.0/autotest/client/tests/ubuntu_squashfs_smoke_test/ubuntu_squashfs_smoke_test.sh'
18:23:15 DEBUG| [stdout] Testing with compression method gzip
18:23:16 INFO | ERROR ubuntu_squashfs_smoke_test.squashfs-smoke-test ubuntu_squashfs_smoke_test.squashfs-smoke-test timestamp=1489170196 localtime=Mar 10 18:23:16 Test subprocess failed rc=9
18:23:16 INFO | END ERROR ubuntu_squashfs_smoke_test.squashfs-smoke-test ubuntu_squashfs_smoke_test.squashfs-smoke-test timestamp=1489170196 localtime=Mar 10 18:23:16

[Colin Ian King (colin-king)]

running in a VM on a ppc64el I'm seeing the madvise stressor breaking as follows:

11:22:01 DEBUG| [stdout] madvise RETURNED 2
11:22:01 DEBUG| [stdout] madvise FAILED
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] 1 processors online, 1 processors configured
11:22:01 DEBUG| [stdout] stress-ng: info: [1440] dispatching hogs: 4 madvise
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] cache allocate: reducing cache level from L3 (too high) to L1
11:22:01 DEBUG| [stdout] stress-ng: info: [1440] cache allocate: default cache size: 64K
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] starting stressors
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] 4 stressors spawned
11:22:01 DEBUG| [stdout] stress-ng: debug: [1444] stress-ng-madvise: started [1444] (instance 3)
11:22:01 DEBUG| [stdout] stress-ng: debug: [1443] stress-ng-madvise: started [1443] (instance 2)
11:22:01 DEBUG| [stdout] stress-ng: debug: [1442] stress-ng-madvise: started [1442] (instance 1)
11:22:01 DEBUG| [stdout] stress-ng: debug: [1441] stress-ng-madvise: started [1441] (instance 0)
11:22:01 DEBUG| [stdout] stress-ng: info: [1444] stress-ng-madvise: caught 39 SIGBUS signals
11:22:01 DEBUG| [stdout] stress-ng: debug: [1444] stress-ng-madvise: exited [1444] (instance 3)
11:22:01 DEBUG| [stdout] stress-ng: info: [1441] stress-ng-madvise: caught 2 SIGBUS signals
11:22:01 DEBUG| [stdout] stress-ng: debug: [1441] stress-ng-madvise: exited [1441] (instance 0)
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] process [1441] terminated
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] process 1442 (stress-ng-madvise) terminated on signal: 9 (Killed)
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] process [1442] terminated
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] process 1443 (stress-ng-madvise) terminated on signal: 9 (Killed)
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] process [1443] terminated
11:22:01 DEBUG| [stdout] stress-ng: debug: [1440] process [1444] terminated
11:22:01 DEBUG| [stdout] stress-ng: info: [1440] unsuccessful run completed in 11.40s
11:22:01 DEBUG| [stdout]
11:22:01 DEBUG| [stdout] malloc STARTING
11:22:02 INFO | ERROR ubuntu_stress_smoke_test.stress-smoke-test ubuntu_stress_smoke_test.stress-smoke-test timestamp=1489490522 localtime=Mar 14 11:22:02 Test subprocess failed rc=9
11:22:06 INFO | END ERROR ubuntu_stress_smoke_test.stress-smoke-test ubuntu_stress_smoke_test.stress-smoke-test timestamp=1489490522 localtime=Mar 14 11:22:02
11:22:12 DEBUG| Persistent state client._record_indent now set to 1
11:22:12 DEBUG| Persistent state client.unexpected_reboot deleted
11:22:12 INFO | END GOOD ---- ---- timestamp=1489490532 localtime=Mar 14 11:22:12
11:22:12 DEBUG| Persistent state client._record_indent now set to 0

There isn't much free memory after this, and the zfs tests fail to work because of low memory:

ubuntu@testvm:~$ free
              total used free shared buff/cache available
Mem: 2074816 1852032 9920 30976 212864 66432
Swap: 0

$ cat /proc/meminfo
MemTotal: 2074816 kB
MemFree: 10432 kB
MemAvailable: 67072 kB
Buffers: 8640 ...

[Colin Ian King (colin-king)]

Fix committed:
http://kernel.ubuntu.com/git/cking/stress-ng.git/commit/?id=cc6e788c56cc6d7de6168e9c5763063968916f0e

[Colin Ian King (colin-king)]

Seems to trundle through the tests to completion now. The tests pull directly from the stress-ng git repo, so it's good to go. I'll mark it as fixed committed for now and I'll upload the released version of stress-ng next week as I've got a load of minor bug fixes that I'm working on for the next release.

[Colin Ian King (colin-king)]

And tested against the released version of fwts. All good, no failures. Marking as fixed released.

[Colin Ian King (colin-king)]

Oops, I meant stress-ng and not fwts. Doh