ssh: "/tmp/adt-run-wrapper: command not found" error if testbed setup fails

[Vincent Ladeuil]

http://d-jenkins.ubuntu-ci:8080/job/vivid-boottest-wayland/1/console failed.

This is the expected behavior.

The output may be clearer if the following wasn't shown:

08:24:55 E: ERROR: timed out waiting for Unity greeter
08:24:56 E: sudo: /tmp/adt-run-wrapper: command not found
08:24:56 E: sudo: /tmp/adt-run-wrapper: command not found
08:24:56 E: <VirtSubproc>: failure: (down) ['rm', '-rf', '/tmp/sudo_askpass.72bv'] failed (exit status 1)
08:24:56 E: while cleaning up because of another error:
08:24:56 E: <VirtSubproc>: failure: setup script reboot failed with code 1
08:24:56 E: adt-run: DBG: bomb unexpected eof from the testbed
08:24:56 E: adt-run: DBG: testbed stop
08:24:56 E: adt-run: DBG: testbed close, scratch=/tmp/adt-run.HCePHR
08:24:56 E: adt-run: DBG: sending command to testbed: close
08:24:56 E: adt-run: DBG: bomb cannot send to testbed: ['BrokenPipeError: [Errno 32] Broken pipe\n']
08:24:56 E: adt-run: DBG: testbed stop
08:24:56 E: adt-run [08:24:56]: ERROR: testbed failed: cannot send to testbed: ['BrokenPipeError: [Errno 32] Broken pipe\n']
08:24:56 E: adt-run: DBG: testbed stop
08:24:56 E: adt-run: DBG: / tests-tree rmtree results/tests-tree
08:25:56 E: + RET=16

Especially:

08:24:56 E: sudo: /tmp/adt-run-wrapper: command not found

08:24:56 E: <VirtSubproc>: failure: (down) ['rm', '-rf', '/tmp/sudo_askpass.72bv'] failed (exit status 1)
08:24:56 E: while cleaning up because of another error:

On the other hand, I can understand the desire to expose adt-run error handling for debug purposes.

[Martin Pitt (pitti)]

This is how it looks like for me with 3.9.6:

$ adt-run -B ~/ubuntu/tmp/testpkg// --- ssh -s adb
adt-run [12:29:47]: git checkout: c97d402 Include "Package-Type: deb" marked packages for testing
Waiting for device ADB to appear...
Configuring Ubuntu phone for testing...
Preparing Ubuntu phone for running tests...
Waiting for desktop to boot
ERROR: timed out waiting for Unity greeter
<VirtSubproc>: failure: setup script failed with code 1: ssh-setup/adb open
adt-run [12:29:48]: ERROR: testbed failed: cannot send to testbed: ['BrokenPipeError: [Errno 32] Broken pipe\n']

which is quite reasonable. Which autopkgtest version do you have?

[Martin Pitt (pitti)]

I also tried with "timeout 600 adt-run ...", with -o, and with a test that requires root (i. e. uses sudo), but I still can't reproduce this.

[Vincent Ladeuil (vila)]

> Which autopkgtest version do you have?

adt-run is helpfully providing this ;) :

08:16:39 E: adt-run [08:16:39]: version 3.9.6-0~1054~ubuntu14.04.1

08:16:39 E: + timeout 600 adt-run --debug --no-built-binaries --unbuilt-tree /var/lib/jenkins/slaves/krillin-09/workspace/vivid-boottest-wayland/test-runner/scripts/../tests/getpkgsrc -o pkgsrc --apt-pocket=proposed --setup-commands=adt-commands --- adt-virt-ssh -s /usr/share/autopkgtest/ssh-setup/adb -- -s JW010053

May be --debug is providing the additional output ?

If that's the case, feel free to close this bug ;)

[Martin Pitt (pitti)]

> May be --debug is providing the additional output ?

That's all the lines with "adt-run: DBG: ", and they will stay. I'm concerned about the "sudo: /tmp/adt-run-wrapper: command not found" issue, that's the bit that I cannot reproduce, at least not with the emulator.

[Vincent Ladeuil (vila)]

> That's all the lines with "adt-run: DBG: "

Bah, of course, thanks for the reminder ;)

[Vincent Ladeuil (vila)]

In a different run, still same adt version http://d-jenkins.ubuntu-ci:8080/job/vivid-boottest-language-pack-touch-it/1/console there is only:

16:52:41 E: ERROR: timed out waiting for Unity greeter
16:52:41 E: <VirtSubproc>: failure: setup script failed with code 1: /usr/share/autopkgtest/ssh-setup/adb open -s JW010053
16:52:41 E: adt-run: DBG: bomb unexpected eof from the testbed
16:52:41 E: adt-run: DBG: testbed stop
16:52:41 E: adt-run: DBG: testbed close, scratch=None
16:52:41 E: adt-run: DBG: sending command to testbed: quit
16:52:41 E: adt-run: DBG: bomb cannot send to testbed: ['BrokenPipeError: [Errno 32] Broken pipe\n']
16:52:41 E: adt-run: DBG: testbed stop
16:52:41 E: adt-run [16:52:41]: ERROR: testbed failed: cannot send to testbed: ['BrokenPipeError: [Errno 32] Broken pipe\n']
16:52:41 E: adt-run: DBG: testbed stop
16:52:41 E: + RET=16

So, that one is indeed reasonable and the first reported one may be caused by some race ?

[Martin Pitt (pitti)]

> So, that one is indeed reasonable and the first reported one may be caused by some race ?

Indeed. I'll try to run it a few times, and have a deeper look when this could happen.

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Federico Gimenez (fgimenez)]

Hi, this seems to be similar to #1470209, I'm still getting this error eventually.

[Federico Gimenez (fgimenez)]

Actual link: https://bugs.launchpad.net/ubuntu/+source/autopkgtest/+bug/1470209