Comment 4 for bug 1309703

Thanks for your suggestion - I'll mention it to Mike Holmes and
it might be a good direction for the future.

In retrospect I understand that linking post-build test results
back into the Jenkins project status is probably not feasible due to
the complexity and open nature of the LAVA test capabilities...
i.e. defining which results should alter that status and how they
should alter it.

Meanwhile Mike addressed the lack of notification with a filter on the LAVA
results
that generates emails to subscribers when LAVA gets such a
catastrophic failure... so we should be covered if something like this
happens again.

On Fri, Apr 25, 2014 at 4:37 AM, Milosz Wasilewski <
<email address hidden>> wrote:

> @Gary
> I'm not sure there is a way to alter the build status after it's completed
> in Jenkins. The best you can have is to get some testing results and have
> green/red indication in this area. AFAIK that is not implemented with
> post-build-lava and I didn't hear any plans to do so.
>
> As a workaround you can probably use qa-reports.linaro.org (just
> launched). It shows both: build in jenkins and lava test statuses in one
> place. The prerequisite is to have post-build-lava configured for your
> build and your jenkins project added to qa-reports. If you're
> interested, let me know. The project is still in early stages but I'm
> happy to help with all requests coming :)
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1309703
>
> Title:
> Failure to boot test kernel image not reflected in CI status
>
> Status in Linaro Continuous Integration:
> New
>
> Bug description:
> A recent bug in a CI script caused filesystem images and hwpack images
> generated for kernel testing to be built without device trees. The
> actual Jenkins build process completed without error because the
> instructions to build the device tree were missing, and all the
> included build operations completed successfully even though the
> resulting image contained no device tree.
>
> When these defective images were passed to LAVA for post-build testing
> the test kernel images naturally failed to boot. LAVA responded
> appropriately and eventually logged the failure after repeated
> retries... however the failure status was not propagated back to
> reflect in the status of the Jenkins CI build/test operation. The
> result was that the cumulative status reported for the Jenkins CI
> builds showed a 'green light' and gave no indication that there were
> errors in the build or in the post-build tests.
>
> See LAVA job #120948 for a log of the problem.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/linaro-ci/+bug/1309703/+subscriptions
>