ppc64el unit test timeout

[Curtis Hovey]

Both master and 1.23 fail because a timeout in agent/machine_test and/or agent/upgrade_test.

The bug blocks the release of 1.23.0 because Ubuntu will not accept a regression on the tests. Engineers can fix the test or skip it if the deem the issue is a broken compiler.

[Curtis Hovey (sinzui)]

Attached is the most recent log.

[Ian Booth (wallyworld)]

Looks like there's still issues with the machine agent completing upgrades when run on ppc64.

There's already a skip for this test on I386. Maybe we also need to add a skip for PPC64

TestUpgradeStepsStateServer

github_com_juju_juju_cmd_jujud_agent.Stop.pN49_github_com_juju_juju_cmd_jujud_agent.MachineAgent
 /home/ubuntu/juju-core_1.23-beta2/src/github.com/juju/juju/cmd/jujud/agent/machine.go:320
agent.$nested187
 /home/ubuntu/juju-core_1.23-beta2/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:835
gopkg_in_check_v1.stopNow.pN19_gopkg_in_check_v1.C
 /home/ubuntu/juju-core_1.23-beta2/src/gopkg.in/check.v1/check.go:97
gopkg_in_check_v1.Assert.pN19_gopkg_in_check_v1.C
 /home/ubuntu/juju-core_1.23-beta2/src/gopkg.in/check.v1/helpers.go:174
agent.waitForUpgradeToFinish
 /home/ubuntu/juju-core_1.23-beta2/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:855
github_com_juju_juju_cmd_jujud_agent.assertUpgradeSteps.pN49_github_com_juju_juju_cmd_jujud_agent.UpgradeSuite
 /home/ubuntu/juju-core_1.23-beta2/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:778
github_com_juju_juju_cmd_jujud_agent.TestUpgradeStepsStateServer.pN49_github_com_juju_juju_cmd_jujud_agent.UpgradeSuite
 /home/ubuntu/juju-core_1.23-beta2/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:451
gopkg_in_check_v1.Call.N28_gopkg_in_check_v1.methodType
 /home/ubuntu/juju-core_1.23-beta2/src/gopkg.in/check.v1/check.go:49
check.$nested2
 /home/ubuntu/juju-core_1.23-beta2/src/gopkg.in/check.v1/check.go:761
check.$nested0
 /home/ubuntu/juju-core_1.23-beta2/src/gopkg.in/check.v1/check.go:655
created by gopkg_in_check_v1.forkCall.pN29_gopkg_in_check_v1.suiteRunner
 /home/ubuntu/juju-core_1.23-beta2/src/gopkg.in/check.v1/check.go:652

[Martin Packman (gz)]

So, one skip has landed for this already on trunk, but we're still getting failures such as:

<http://reports.vapour.ws/releases/2536/job/run-unit-tests-trusty-ppc64el/attempt/2782>

goroutine 14818 [chan receive]:
launchpad.net_tomb.Wait.pN23_launchpad.net_tomb.Tomb
 /home/ubuntu/juju-core_1.24-alpha1/src/launchpad.net/tomb/tomb.go:110
github.com_juju_juju_cmd_jujud_agent.Stop.pN49_github.com_juju_juju_cmd_jujud_agent.MachineAgent
 /home/ubuntu/juju-core_1.24-alpha1/src/github.com/juju/juju/cmd/jujud/agent/machine.go:322
agent.$nested193
 /home/ubuntu/juju-core_1.24-alpha1/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:837
gopkg.in_check.v1.stopNow.pN19_gopkg.in_check.v1.C
 /home/ubuntu/juju-core_1.24-alpha1/src/gopkg.in/check.v1/check.go:97
gopkg.in_check.v1.Assert.pN19_gopkg.in_check.v1.C
 /home/ubuntu/juju-core_1.24-alpha1/src/gopkg.in/check.v1/helpers.go:174
agent.waitForUpgradeToFinish
 /home/ubuntu/juju-core_1.24-alpha1/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:857
github.com_juju_juju_cmd_jujud_agent.assertUpgradeSteps.pN49_github.com_juju_juju_cmd_jujud_agent.UpgradeSuite
 /home/ubuntu/juju-core_1.24-alpha1/src/github.com/juju/juju/cmd/jujud/agent/upgrade_test.go:780
github.com_juju_juju_cmd_jujud_agent.TestUpgradeStepsHostMachine.pN49_github.com_juju_juju_cmd_jujud_agent.UpgradeSuite
...

Only skipped TestUpgradeStepsStateServer but apparently TestUpgradeStepsHostMachine is also unhappy now?