loop / pty test in ubuntu_stress_smoke_test failed with P-3.2

[Po-Hsu Lin]

This is a KVM node with 3.13 kernel on Precise

$ uname -a
Linux curly 3.2.0-136-generic #182-Ubuntu SMP Tue Sep 25 10:57:01 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

The loop and test in ubuntu_stress_smoke_test will fail:

10:16:55 DEBUG| [stdout] loop STARTING
10:16:55 DEBUG| [stdout] loop RETURNED 2
10:16:55 DEBUG| [stdout] loop FAILED
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] 2 processors online, 2 processors configured
10:16:55 DEBUG| [stdout] stress-ng: info: [7616] dispatching hogs: 4 loop
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] cache allocate: reducing cache level from L3 (too high) to L2
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] cache allocate: default cache size: 4096K
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] starting stressors
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] 4 stressors spawned
10:16:55 DEBUG| [stdout] stress-ng: debug: [7617] stress-ng-loop: started [7617] (instance 0)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7619] stress-ng-loop: started [7619] (instance 2)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7620] stress-ng-loop: started [7620] (instance 3)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7617] stress-ng-loop: failed to disassociate /dev/loop0 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7618] stress-ng-loop: started [7618] (instance 1)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7620] stress-ng-loop: failed to disassociate /dev/loop2 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7619] stress-ng-loop: failed to disassociate /dev/loop2 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7617] stress-ng-loop: failed to disassociate /dev/loop3 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7619] stress-ng-loop: failed to disassociate /dev/loop4 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7620] stress-ng-loop: failed to disassociate /dev/loop5 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:16:55 DEBUG| [stdout] stress-ng: fail: [7619] stress-ng-loop: failed to disassociate /dev/loop7 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:16:55 DEBUG| [stdout] stress-ng: debug: [7620] stress-ng-loop: exited [7620] (instance 3)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7617] stress-ng-loop: failed to disassociate /dev/loop2 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:16:55 DEBUG| [stdout] stress-ng: debug: [7619] stress-ng-loop: exited [7619] (instance 2)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7617] stress-ng-loop: exited [7617] (instance 0)
10:16:55 DEBUG| [stdout] stress-ng: error: [7616] process 7617 (stress-ng-loop) terminated with an error, exit status=1 (stress-ng core failure)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] process [7617] terminated
10:16:55 DEBUG| [stdout] stress-ng: fail: [7618] stress-ng-loop: failed to disassociate /dev/loop2 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] stress-ng: fail: [7618] stress-ng-loop: failed to disassociate /dev/loop0 from backing store, errno=16 (Device or resource busy)
10:16:55 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:16:55 DEBUG| [stdout] stress-ng: debug: [7618] stress-ng-loop: exited [7618] (instance 1)
10:16:55 DEBUG| [stdout] stress-ng: error: [7616] process 7618 (stress-ng-loop) terminated with an error, exit status=1 (stress-ng core failure)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] process [7618] terminated
10:16:55 DEBUG| [stdout] stress-ng: error: [7616] process 7619 (stress-ng-loop) terminated with an error, exit status=1 (stress-ng core failure)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] process [7619] terminated
10:16:55 DEBUG| [stdout] stress-ng: error: [7616] process 7620 (stress-ng-loop) terminated with an error, exit status=1 (stress-ng core failure)
10:16:55 DEBUG| [stdout] stress-ng: debug: [7616] process [7620] terminated
10:16:55 DEBUG| [stdout] stress-ng: info: [7616] unsuccessful run completed in 0.14s

10:21:03 DEBUG| [stdout] pty STARTING
10:21:08 DEBUG| [stdout] pty RETURNED 2
10:21:08 DEBUG| [stdout] pty FAILED
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] 2 processors online, 2 processors configured
10:21:08 DEBUG| [stdout] stress-ng: info: [24423] dispatching hogs: 4 pty
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] cache allocate: reducing cache level from L3 (too high) to L2
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] cache allocate: default cache size: 4096K
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] starting stressors
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] 4 stressors spawned
10:21:08 DEBUG| [stdout] stress-ng: debug: [24426] stress-ng-pty: started [24426] (instance 2)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24427] stress-ng-pty: started [24427] (instance 3)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24424] stress-ng-pty: started [24424] (instance 0)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24425] stress-ng-pty: started [24425] (instance 1)
10:21:08 DEBUG| [stdout] stress-ng: fail: [24426] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] stress-ng: fail: [24424] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] stress-ng: fail: [24426] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] stress-ng: fail: [24424] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] stress-ng: fail: [24425] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] stress-ng: fail: [24424] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:21:08 DEBUG| [stdout] stress-ng: fail: [24427] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:21:08 DEBUG| [stdout] stress-ng: fail: [24426] stress-ng-pty: open /dev/ptmx failed, errno=5 (Input/output error)
10:21:08 DEBUG| [stdout] info: 5 failures reached, aborting stress process
10:21:08 DEBUG| [stdout] stress-ng: debug: [24427] stress-ng-pty: exited [24427] (instance 3)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24426] stress-ng-pty: exited [24426] (instance 2)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24424] stress-ng-pty: exited [24424] (instance 0)
10:21:08 DEBUG| [stdout] stress-ng: error: [24423] process 24424 (stress-ng-pty) terminated with an error, exit status=1 (stress-ng core failure)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] process [24424] terminated
10:21:08 DEBUG| [stdout] stress-ng: debug: [24425] stress-ng-pty: exited [24425] (instance 1)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] process [24425] terminated
10:21:08 DEBUG| [stdout] stress-ng: error: [24423] process 24426 (stress-ng-pty) terminated with an error, exit status=1 (stress-ng core failure)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] process [24426] terminated
10:21:08 DEBUG| [stdout] stress-ng: error: [24423] process 24427 (stress-ng-pty) terminated with an error, exit status=1 (stress-ng core failure)
10:21:08 DEBUG| [stdout] stress-ng: debug: [24423] process [24427] terminated
10:21:08 DEBUG| [stdout] stress-ng: info: [24423] unsuccessful run completed in 5.03s

[Po-Hsu Lin (cypressyew)]

Can be reproduce on bare-metal system with 3.2.0-137.183-generic

[Colin Ian King (colin-king)]

Loop test failure required a retry if EBUSY occurred, fix committed:

http://kernel.ubuntu.com/git/cking/stress-ng.git/commit/?id=017f646bb0efbc548fd791cceab0d425a733be57

[Colin Ian King (colin-king)]

Added EIO check in ptmx open, fix committed:

http://kernel.ubuntu.com/git/cking/stress-ng.git/commit/?id=81a1c2d109e0a41f9bdf8e06dd2a5a9ebf41c0c9

[Po-Hsu Lin (cypressyew)]

Re-tested on two bare-metal systems, the stress smoke test passed without any issue.
Thanks!