state/leadership: sporadic test timeout

Bug #1506338 reported by Roger Peppe
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
juju-core
Expired
Medium
Unassigned

Bug Description

I've seen this once, but perhaps this stack dump from
the timed-out test might be enough
to diagnose the problem. For some reason it seems to have
got stuck in leadership.manager.loop when running
ExpireLeadershipSuite.TestExpire_Multiple.

SIGQUIT: quit
PC=0x43fc01

goroutine 0 [idle]:
runtime.futex(0xec1338, 0x0, 0x0, 0x0, 0x0, 0xec06e0, 0x1, 0x40c97f, 0x40cb9e, 0xec1338, ...)
 /home/rog/go/src/runtime/sys_linux_amd64.s:277 +0x21
runtime.futexsleep(0xec1338, 0x0, 0xffffffffffffffff)
 /home/rog/go/src/runtime/os_linux.c:49 +0x47
runtime.notesleep(0xec1338)
 /home/rog/go/src/runtime/lock_futex.go:145 +0xae
stopm()
 /home/rog/go/src/runtime/proc.c:1178 +0x119
findrunnable(0xc208012000)
 /home/rog/go/src/runtime/proc.c:1487 +0x562
schedule()
 /home/rog/go/src/runtime/proc.c:1575 +0x151
runtime.park_m(0xc2080005a0)
 /home/rog/go/src/runtime/proc.c:1654 +0x113
runtime.mcall(0x432df4)
 /home/rog/go/src/runtime/asm_amd64.s:186 +0x5a

goroutine 1 [chan receive, 9 minutes]:
testing.RunTests(0xc90148, 0xeb5de0, 0x1, 0x1, 0x1)
 /home/rog/go/src/testing/testing.go:556 +0xad6
testing.(*M).Run(0xc2081422d0, 0xec8640)
 /home/rog/go/src/testing/testing.go:485 +0x6c
main.main()
 github.com/juju/juju/state/leadership/_test/_testmain.go:54 +0x1d5

goroutine 5 [syscall, 9 minutes]:
os/signal.loop()
 /home/rog/go/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
 /home/rog/go/src/os/signal/signal_unix.go:27 +0x35

goroutine 11 [chan receive, 7 minutes]:
gopkg.in/check%2ev1.(*suiteRunner).runTest(0xc2080e2880, 0xc20809a850, 0xc2080b93b0)
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:810 +0x5e
gopkg.in/check%2ev1.(*suiteRunner).run(0xc2080e2880, 0xc20802b580)
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:615 +0x29c
gopkg.in/check%2ev1.Run(0xafa1e0, 0xc20802b580, 0xc20802b640, 0xc2080947e0)
 /home/rog/src/go/src/gopkg.in/check.v1/run.go:92 +0x4a
gopkg.in/check%2ev1.RunAll(0xc20802b640, 0x0)
 /home/rog/src/go/src/gopkg.in/check.v1/run.go:84 +0xc2
gopkg.in/check%2ev1.TestingT(0xc208094630)
 /home/rog/src/go/src/gopkg.in/check.v1/run.go:72 +0x1fd
github.com/juju/juju/state/leadership_test.TestPackage(0xc208094630)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/package_test.go:13 +0x28
testing.tRunner(0xc208094630, 0xeb5de0)
 /home/rog/go/src/testing/testing.go:447 +0xbf
created by testing.RunTests
 /home/rog/go/src/testing/testing.go:555 +0xa8b

goroutine 133 [chan receive, 7 minutes]:
launchpad.net/tomb.(*Tomb).Wait(0xc208147020, 0x0, 0x0)
 /home/rog/src/go/src/launchpad.net/tomb/tomb.go:110 +0x61
github.com/juju/juju/state/leadership.(*manager).Wait(0xc208147020, 0x0, 0x0)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager.go:79 +0x41
github.com/juju/juju/state/leadership_test.func·057(0x7f17d65a30e8, 0xc208147020, 0xc208132a00)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager_expire_test.go:281 +0x65
github.com/juju/juju/state/leadership_test.(*Fixture).RunTest(0xc208151b00, 0xc2080b9860, 0xc20810f938)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/fixture_test.go:89 +0x46a
github.com/juju/juju/state/leadership_test.(*ExpireLeadershipSuite).TestExpire_Multiple(0xc20802b580, 0xc2080b9860)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager_expire_test.go:283 +0x92d
reflect.Value.call(0xafa1e0, 0xc20802b580, 0x1d13, 0xb1ee50, 0x4, 0xc20810ff78, 0x1, 0x1, 0x0, 0x0, ...)
 /home/rog/go/src/reflect/value.go:419 +0x10e5
reflect.Value.Call(0xafa1e0, 0xc20802b580, 0x1d13, 0xc20810ff78, 0x1, 0x1, 0x0, 0x0, 0x0)
 /home/rog/go/src/reflect/value.go:296 +0xbc
gopkg.in/check%2ev1.func·003(0xc2080b9860)
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:772 +0x401
gopkg.in/check%2ev1.func·001()
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:666 +0x92
created by gopkg.in/check%2ev1.(*suiteRunner).forkCall
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:667 +0x3fd

goroutine 115 [select, 7 minutes]:
gopkg.in/check%2ev1.(*resultTracker)._loopRoutine(0xc208094510)
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:461 +0x387
created by gopkg.in/check%2ev1.(*resultTracker).start
 /home/rog/src/go/src/gopkg.in/check.v1/check.go:441 +0x32

goroutine 135 [select, 7 minutes]:
github.com/juju/juju/state/leadership.(*manager).choose(0xc208147020, 0xc208151b60, 0x0, 0x0)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager.go:101 +0x4f1
github.com/juju/juju/state/leadership.(*manager).loop(0xc208147020, 0x0, 0x0)
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager.go:86 +0x78
github.com/juju/juju/state/leadership.func·001()
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager.go:39 +0x58
created by github.com/juju/juju/state/leadership.NewManager
 /home/rog/src/go/src/github.com/juju/juju/state/leadership/manager.go:40 +0x28e

rax 0xca
rbx 0xec1338
rcx 0xffffffffffffffff
rdx 0x0
rdi 0xec1338
rsi 0x0
rbp 0x1
rsp 0x7ffff3aa69b8
r8 0x0
r9 0x0
r10 0x0
r11 0x286
r12 0x0
r13 0x3
r14 0x2
r15 0xc2080e0600
rip 0x43fc01
rflags 0x286
cs 0x33
fs 0x0
gs 0x0
*** Test killed with quit: ran too long (10m0s).
FAIL github.com/juju/juju/state/leadership 600.009s

Martin Packman (gz)
tags: added: intermittent-failure test-failure
Changed in juju-core:
importance: Undecided → Medium
status: New → Triaged
Curtis Hovey (sinzui)
Changed in juju-core:
status: Triaged → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for juju-core because there has been no activity for 60 days.]

Changed in juju-core:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.