autopkgtests: testsslsocketlinereader fails in bionic since openssl 1.1.1

[Rik Mills]

Discussed here: https://irclogs.ubuntu.com/2019/08/06/%23ubuntu-devel.html#t10:36

Example failures: https://autopkgtest.ubuntu.com/packages/kdeconnect/bionic/amd64

Start of failures coincides with packages installed to run the testsuite including openssl 1.1.1 from security/updates instead of 1.0.0g.

This test has always been 'flaky/racy'. Debian included a patch post bionic/comsic that helped on debian CI, but this did not fix the issue on Ubuntu infra. On consulting with upstream KDE, the test was disabled during disco development cycle.

It should be noted that the failure of this test has not to my knowledge correlated with a user facing functional issue.

********* Start testing of TestSslSocketLineReader *********
Config: Using QtTest library 5.9.5, Qt 5.9.5 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 7.4.0)
PASS : TestSslSocketLineReader::initTestCase()
FAIL! : TestSslSocketLineReader::testTrustedDevice() 'serverSocket->isEncrypted()' returned FALSE. (Server is not encrypted)
   Loc: [/tmp/autopkgtest.4iVfvM/build.wUi/src/tests/testsslsocketlinereader.cpp(135)]
FAIL! : TestSslSocketLineReader::testUntrustedDevice() 'serverSocket->isEncrypted()' returned FALSE. (Server is not encrypted)
   Loc: [/tmp/autopkgtest.4iVfvM/build.wUi/src/tests/testsslsocketlinereader.cpp(194)]
PASS : TestSslSocketLineReader::testTrustedDeviceWithWrongCertificate()
PASS : TestSslSocketLineReader::cleanupTestCase()
Totals: 3 passed, 2 failed, 0 skipped, 0 blacklisted, 799ms
********* Finished testing of TestSslSocketLineReader *********

[Dmitry Shachnev (mitya57)]

FWIW, I think this upstream merge request should fix the failures: https://invent.kde.org/kde/kdeconnect-kde/merge_requests/42.

But unless we need a kdeconnect Bionic upload for other reasons, I would just ignore the failures.

[Rik Mills (rikmills)]

On 02/09/2019 12:05, Dmitry Shachnev wrote:
> FWIW, I think this upstream merge request should fix the failures:
> https://invent.kde.org/kde/kdeconnect-kde/merge_requests/42.
>
> But unless we need a kdeconnect Bionic upload for other reasons, I would
> just ignore the failures.
>

That patch is already merged from debian in kdeconnect for >= disco,
where it did not help on Ubuntu infra

[Łukasz Zemczak (sil2100)]

As per IRC discussion, with the bug filled, I have hinted kdeconnect for now. Thanks for writing it up!