Submissions missing test output still happen

[Jeff Lane ]

There was a bug open on this, and it's been moved to some other project and I don't know if that is Checkbox-ng, plainbox, or a provider or what. So I'm filing a new bug with new data.

Results are here:

https://certification.canonical.com/hardware/201412-16324/submission/104230/test-results/

Note that in those results, not a single test has output at all.

This is 12.04.5 (yes, we still accept Precise and will for some time in ServerLand because enterprise customers are still deploying it regularly).

And seems to be using plainbox on Precise:

checkbox-ng 0.19.1~ppa~ubuntu12.04.1
plainbox-provider-checkbox 0.20.1~ppa1~ubuntu12.04.1
python3-checkbox-ng 0.19.1~ppa~ubuntu12.04.1
python3-checkbox-support 0.19~ppa~ubuntu12.04.1
canonical-certification-server 0.16.2~ppa~ubuntu12.04.1
canonical-certification-submit 0.16.2~ppa~ubuntu12.04.1

I've attached a tarball with a lot of logs and session data for this. Note in the io-logs that there are a LOT of 0 byte files, so the output is either being discarded or ignored, but it only seems to affect actual tests. Info tests seem to be just fine, which is odd.

[Zygmunt Krynicki (zyga)]

I'll check this out, thanks for the detailed report.

On Wed, Jul 8, 2015 at 4:57 PM, Jeff Lane <email address hidden> wrote:
> Public bug reported:
>
> There was a bug open on this, and it's been moved to some other project
> and I don't know if that is Checkbox-ng, plainbox, or a provider or
> what. So I'm filing a new bug with new data.
>
> Results are here:
>
> https://certification.canonical.com/hardware/201412-16324/submission/104230
> /test-results/
>
> Note that in those results, not a single test has output at all.
>
> This is 12.04.5 (yes, we still accept Precise and will for some time in
> ServerLand because enterprise customers are still deploying it
> regularly).
>
> And seems to be using plainbox on Precise:
>
> checkbox-ng 0.19.1~ppa~ubuntu12.04.1
> plainbox-provider-checkbox 0.20.1~ppa1~ubuntu12.04.1
> python3-checkbox-ng 0.19.1~ppa~ubuntu12.04.1
> python3-checkbox-support 0.19~ppa~ubuntu12.04.1
> canonical-certification-server 0.16.2~ppa~ubuntu12.04.1
> canonical-certification-submit 0.16.2~ppa~ubuntu12.04.1
>
> I've attached a tarball with a lot of logs and session data for this.
> Note in the io-logs that there are a LOT of 0 byte files, so the output
> is either being discarded or ignored, but it only seems to affect actual
> tests. Info tests seem to be just fine, which is odd.
>
> ** Affects: checkbox
> Importance: Undecided
> Status: New
>
> ** Attachment added: "cache.tgz"
> https://bugs.launchpad.net/bugs/1472652/+attachment/4426420/+files/cache.tgz
>
> --
> You received this bug notification because you are a member of Checkbox
> Bug Wranglers, which is subscribed to Checkbox.
> https://bugs.launchpad.net/bugs/1472652
>
> Title:
> Submissions missing test output still happen
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/checkbox/+bug/1472652/+subscriptions

[Zygmunt Krynicki (zyga)]

Hmm.

So there is some output in many of the jobs (log files). If it doesn't
reach the website then maybe the bug is in the exporter code.

On Wed, Jul 8, 2015 at 5:44 PM, Zygmunt Krynicki
<email address hidden> wrote:
> I'll check this out, thanks for the detailed report.
>
> On Wed, Jul 8, 2015 at 4:57 PM, Jeff Lane <email address hidden> wrote:
>> Public bug reported:
>>
>> There was a bug open on this, and it's been moved to some other project
>> and I don't know if that is Checkbox-ng, plainbox, or a provider or
>> what. So I'm filing a new bug with new data.
>>
>> Results are here:
>>
>> https://certification.canonical.com/hardware/201412-16324/submission/104230
>> /test-results/
>>
>> Note that in those results, not a single test has output at all.
>>
>> This is 12.04.5 (yes, we still accept Precise and will for some time in
>> ServerLand because enterprise customers are still deploying it
>> regularly).
>>
>> And seems to be using plainbox on Precise:
>>
>> checkbox-ng 0.19.1~ppa~ubuntu12.04.1
>> plainbox-provider-checkbox 0.20.1~ppa1~ubuntu12.04.1
>> python3-checkbox-ng 0.19.1~ppa~ubuntu12.04.1
>> python3-checkbox-support 0.19~ppa~ubuntu12.04.1
>> canonical-certification-server 0.16.2~ppa~ubuntu12.04.1
>> canonical-certification-submit 0.16.2~ppa~ubuntu12.04.1
>>
>> I've attached a tarball with a lot of logs and session data for this.
>> Note in the io-logs that there are a LOT of 0 byte files, so the output
>> is either being discarded or ignored, but it only seems to affect actual
>> tests. Info tests seem to be just fine, which is odd.
>>
>> ** Affects: checkbox
>> Importance: Undecided
>> Status: New
>>
>> ** Attachment added: "cache.tgz"
>> https://bugs.launchpad.net/bugs/1472652/+attachment/4426420/+files/cache.tgz
>>
>> --
>> You received this bug notification because you are a member of Checkbox
>> Bug Wranglers, which is subscribed to Checkbox.
>> https://bugs.launchpad.net/bugs/1472652
>>
>> Title:
>> Submissions missing test output still happen
>>
>> To manage notifications about this bug go to:
>> https://bugs.launchpad.net/checkbox/+bug/1472652/+subscriptions

[Zygmunt Krynicki (zyga)]

I'll try to export an xml report from the sessions you gave me and report back.

On Wed, Jul 8, 2015 at 5:47 PM, Zygmunt Krynicki
<email address hidden> wrote:
> Hmm.
>
> So there is some output in many of the jobs (log files). If it doesn't
> reach the website then maybe the bug is in the exporter code.
>
> On Wed, Jul 8, 2015 at 5:44 PM, Zygmunt Krynicki
> <email address hidden> wrote:
>> I'll check this out, thanks for the detailed report.
>>
>> On Wed, Jul 8, 2015 at 4:57 PM, Jeff Lane <email address hidden> wrote:
>>> Public bug reported:
>>>
>>> There was a bug open on this, and it's been moved to some other project
>>> and I don't know if that is Checkbox-ng, plainbox, or a provider or
>>> what. So I'm filing a new bug with new data.
>>>
>>> Results are here:
>>>
>>> https://certification.canonical.com/hardware/201412-16324/submission/104230
>>> /test-results/
>>>
>>> Note that in those results, not a single test has output at all.
>>>
>>> This is 12.04.5 (yes, we still accept Precise and will for some time in
>>> ServerLand because enterprise customers are still deploying it
>>> regularly).
>>>
>>> And seems to be using plainbox on Precise:
>>>
>>> checkbox-ng 0.19.1~ppa~ubuntu12.04.1
>>> plainbox-provider-checkbox 0.20.1~ppa1~ubuntu12.04.1
>>> python3-checkbox-ng 0.19.1~ppa~ubuntu12.04.1
>>> python3-checkbox-support 0.19~ppa~ubuntu12.04.1
>>> canonical-certification-server 0.16.2~ppa~ubuntu12.04.1
>>> canonical-certification-submit 0.16.2~ppa~ubuntu12.04.1
>>>
>>> I've attached a tarball with a lot of logs and session data for this.
>>> Note in the io-logs that there are a LOT of 0 byte files, so the output
>>> is either being discarded or ignored, but it only seems to affect actual
>>> tests. Info tests seem to be just fine, which is odd.
>>>
>>> ** Affects: checkbox
>>> Importance: Undecided
>>> Status: New
>>>
>>> ** Attachment added: "cache.tgz"
>>> https://bugs.launchpad.net/bugs/1472652/+attachment/4426420/+files/cache.tgz
>>>
>>> --
>>> You received this bug notification because you are a member of Checkbox
>>> Bug Wranglers, which is subscribed to Checkbox.
>>> https://bugs.launchpad.net/bugs/1472652
>>>
>>> Title:
>>> Submissions missing test output still happen
>>>
>>> To manage notifications about this bug go to:
>>> https://bugs.launchpad.net/checkbox/+bug/1472652/+subscriptions

[Jeff Lane  (bladernr)]

FWIW, this is only on Precise, thankfully... 14.04 does not, at least in my experience, have this issue. This is a submission file from a system that demonstrated the no-output bug with 12.04 but not on 14.04.