Intermittent unit test failure with Qt 5.6 in yakkety
Bug #1611403 reported by
Olivier Tilloy
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
webbrowser-app (Ubuntu) |
Fix Released
|
Critical
|
Olivier Tilloy |
Bug Description
I’m seeing tst_FaviconFetc
I’m able to reproduce the failure locally in a yakkety chroot:
FAIL! : FaviconFetcherT
Actual (serverSpy->count() + errorSpy->count()): 101
Expected (requests) : 100
Loc: [/tmp/webbrowse
I’m unable to reproduce in the same chroot with Qt 5.5.1.
Related branches
lp:~osomon/webbrowser-app/relax-test-expectation-1611403
- system-apps-ci-bot: Needs Fixing (continuous-integration)
- Ubuntu Phablet Team: Pending requested
-
Diff: 12 lines (+1/-1)1 file modifiedtests/unittests/favicon-fetcher/tst_FaviconFetcherTests.cpp (+1/-1)
Changed in webbrowser-app (Ubuntu): | |
status: | New → In Progress |
importance: | Undecided → Critical |
assignee: | nobody → Olivier Tilloy (osomon) |
To post a comment you must log in.
I’ve been running that one failing test in a loop and most of the failures exhibit an unexpected value of 101, but occasionally some fail with a greater value (observed values of 102, 103, and even 113 and 124).
In all those cases, it appears the value of serverSpy->count() is always 100, and the value of errorSpy->count() is ≥ 0.
I suspect a behaviour change in Qt. We now have to support three different versions:
- 5.4.1 in vivid+overlay
- 5.5.1 in xenial+overlay
- 5.6.1 in yakkety
Given these constraints, it looks like the test expectations will need to be made laxer.