Comment 8 for bug 1855683

From watching it it looks like report generation. IT seems to get by
pretty fast through the test run, then takes a long while at the end
when it's creating the report files (the very end when it's generating
files and dumping links to them on the console)

On Wed, Apr 8, 2020 at 3:51 AM Sylvain Pineau
<email address hidden> wrote:
>
> I'm wondering if the extra report defined in the launcher could be the problem.
> Jeff are you able to say which part costs the most? test execution or report generation?
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1855683
>
> Title:
> checkbox-remote is SLOW when running tests
>
> Status in Next Generation Checkbox (CLI):
> Fix Committed
>
> Bug description:
> Discussed briefly while in the Taipei sprint but when runnign tests
> via checkbox-remote Ive noticed that the tests are insanely slow.
>
> For example, this is running the test-firmware launcher in the server
> provider manually, locally on a machine:
>
> ubuntu@jellyplum:~$ time test-firmware
> =========================[ Resume Incomplete Session ]==========================
> There are 0 incomplete sessions that might be resumed
> Preparing...
> <SNIP>
> real 2m33.180s
> user 1m48.855s
> sys 0m37.771s
>
> And this is the same test run via checkbox-remote locally:
>
>
> ==================================[ Results ]=================================== (H) Help
> file:///home/ubuntu/.local/share/checkbox-ng/submission_2019-12-09T07.47.08.062908.html
> file:///home/ubuntu/.local/share/checkbox-ng/submission_2019-12-09T07.47.08.062908.junit.xml
> file:///home/ubuntu/.local/share/checkbox-ng/submission_2019-12-09T07.47.08.062908.tar.xz
> file:///home/ubuntu/.local/share/checkbox-ng/submission_2019-12-09T07.47.08.062908.xlsx
> Do you want to submit 'upload to certification' report?
> y => yes
> n => no
> [yn]: n
>
> real 24m50.807s
> user 0m23.067s
> sys 0m4.435s
>
> this looked initially like it was due to the sosreport job, since that
> generates a large tarball that is then attached to the submission via
> the attachment plugin, which with remote, transmits this across
> whatever remote is using to transfer data from the slave to the
> master. So I retried this by removing the sosreport jobs.
>
> That seems to have made a huge difference, getting times back down to locally non-remote run attempts:
> real 2m52.436s
> user 0m15.049s
> sys 0m3.158s
>
> So now one last verification, I run checkbox remote over the internet
> without the sosreport job, and the same test plan that just took 3
> minutes is still running after over an hour.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/checkbox-ng/+bug/1855683/+subscriptions
>
> Launchpad-Notification-Type: bug
> Launchpad-Bug: product=checkbox-ng; milestone=1.8.0; status=Fix Committed; importance=High; <email address hidden>;
> Launchpad-Bug-Information-Type: Public
> Launchpad-Bug-Private: no
> Launchpad-Bug-Security-Vulnerability: no
> Launchpad-Bug-Commenters: bladernr sylvain-pineau
> Launchpad-Bug-Reporter: Jeff Lane (bladernr)
> Launchpad-Bug-Modifier: Sylvain Pineau (sylvain-pineau)
> Launchpad-Message-Rationale: Subscriber
> Launchpad-Message-For: bladernr

--
Jeff Lane
Engineering Manager
IHV/OEM Alliances and Server Certification

"Entropy isn't what it used to be."