Checkbox AP crash during generating spreadsheet report

[Alfie Huang]

1.After completed the test item (Somerville,Whitelist_Full) and checkbox is generating spreadsheet report, Checkbox AP crash.
2.While re-launch checkbox and try to "Rerun" again, the test item status will reset from beginning, you need to do all of the test item again.

Version:
checkbox: 0.14.10+bzr1796+201210251038~precise1
checkbox-oem: 0.45-0-precise1~rev614
checkbox-oem-somerville: 0.3-0ubuntu18

[Alfie Huang (alfie073)]

Upload Whitelist for reference.

[Daniel Manrique (roadmr)]

Hello, can you please attach the .checkbox/checkbox-certification.log file? That should contain information about the crash.

Thanks!

[Alfie Huang (alfie073)]

Hi, I use checkbox-oem-somerville for tes and attach file is the log for you reference, thanks.

[Alfie Huang (alfie073)]

Hi Daniel,

We use checkbox oem version (not checkbox certification version).
I upload the log of checkbox-oem-somerville.log for you , it should be the same log that you needed(checkbox-certification.log ), thanks.

[Daniel Manrique (roadmr)]

Thanks!

Sorry to trouble you with another request. I see some errors in the log related to an invalid XML file. Could you please attach the submission.xml file to see what the problem may be?

Thanks!

[Daniel Manrique (roadmr)]

Here's the section with the failures:

012-11-13 02:04:11,997 DEBUG Dumping lsbrelease
2012-11-13 02:04:11,997 DEBUG Dumping packages
2012-11-13 02:04:12,884 ERROR Error running event handler <string> LaunchpadReport.report() for event type 'report'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/checkbox/reactor.py", line 74, in fire
    results.append(handler(*args, **kwargs))
  File "<string>", line 166, in report
  File "/usr/lib/python3/dist-packages/checkbox/report.py", line 143, in validate
    doc = etree.fromstring(string)
  File "lxml.etree.pyx", line 2754, in lxml.etree.fromstring (src/lxml/lxml.etree.c:54631)
  File "parser.pxi", line 1578, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:82748)
  File "parser.pxi", line 1450, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:81481)
  File "parser.pxi", line 925, in lxml.etree._BaseParser._parseUnicodeDoc (src/lxml/lxml.etree.c:77905)
  File "parser.pxi", line 569, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:74472)
  File "parser.pxi", line 650, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:75363)
  File "parser.pxi", line 590, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:74696)
  File "<string>", line None
lxml.etree.XMLSyntaxError: PCDATA invalid Char value 27, line 14209, column 10
2012-11-13 02:04:12,889 DEBUG Finished firing report.
2012-11-13 02:04:12,913 DEBUG Started firing report-json.
2012-11-13 02:04:12,914 DEBUG Calling <string> CertifyReport.report_json(<checkbox_gtk.gtk_interface.GTKInterface object at 0x208a110>) for report-json with priority 0.
2012-11-13 02:04:12,938 DEBUG Finished firing report-json.
2012-11-13 02:04:12,938 DEBUG Finished firing prompt-report.
2012-11-13 02:04:12,938 DEBUG Started firing prompt-exchange.
2012-11-13 02:04:12,938 DEBUG Calling <string> CertifyPrompt.prompt_exchange(<checkbox_gtk.gtk_interface.GTKInterface object at 0x208a110>) for prompt-exchange with priority 0.
2012-11-13 02:04:12,955 DEBUG Started firing xls-report.
2012-11-13 02:04:12,968 DEBUG Calling <string> CertifyPrompt.xls_report() for xls-report with priority 0.
2012-11-13 02:04:19,997 ERROR XLS Report:

not well-formed (invalid token) at line 14209, column 9, byte 461435 at /usr/lib/perl5/XML/Parser.pm line 187
 at /usr/bin/xls_export line 738
 at /usr/bin/xls_export line 738
2012-11-13 02:04:19,997 DEBUG Finished firing xls-report.
2012-11-13 02:04:20,020 DEBUG Started firing report-exchange.
2012-11-13 02:04:20,020 DEBUG Calling <string> Backup.report_exchange(<checkbox_gtk.gtk_interface.GTKInterface object at 0x208a110>) for report-exchange with priority -1.
2012-11-13 02:04:21,542 DEBUG Calling <string> CertifyPrompt.report_exchange(<checkbox_gtk.gtk_interface.GTKInterface object at 0x208a110>) for report-exchange with priority 0.
2012-11-13 02:04:21,542 DEBUG Calling <string> exchange_error() on exchange-error.
2012-11-13 02:04:21,543 ERROR Error running event handler <string> CertifyPrompt.report_exchange(<checkbox_gtk.gtk_interface.GTKInterface object at 0x208a110>) for event type '...

[Alfie Huang (alfie073)]

Hi Daniel,

Attach file is the tar file for .checkbox for you reference, thanks.

[Jeffrey Chang (modern911)]

Set to Critical since this blocked 2 different OEM projects from generating test report.

[Sylvain Pineau (sylvain-pineau)]

Unfortunately, the attached checkbox.tgz doesn't contain the requested xml file and the log doesn't mention the error found in the first checkbox-oem-somerville.log in comment #3. So we miss the crucial part of the problem.

Could you please attach the .checkbox folder of a system where you're about to send the results to the certification website.
At this step the submission.xml should be available in .checkbox.

[Alfie Huang (alfie073)]

Hi Sylvain,

The attach file of checkbox.tgz on #7 comment is the tar file for .checkbox folder, which is "Before AP crash" status.
Use the checkbox.tgz to run the Whitelist-12.04-Full-v1.3.txt on #1 comment, you will see the AP crash issue happens.
After issue happens, the log file is checkbox-oem-somerville.log on #3 comment.

[Alfie Huang (alfie073)]

After the issue happens, the submission.xml file is null status.
It's the Bug Description : 2.While re-launch checkbox and try to "Rerun" again, the test item status will reset from beginning, you need to do all of the test item again.

[Sylvain Pineau (sylvain-pineau)]

Without the xml file I've cat all the files from the .checkbox/store/0 into a single file, adding some xml headers and opened it in firefox to have an idea of where the problem lies.

The first pattern error that I've found is the one generated by camera/multiple-resolution-images, fixed for bug #1075374 in checkbox trunk rev 1810. So this bug is certainly just a duplicate.

Could you please update your version of checkbox with the one available in the checkbox-dev ppa ?
See https://launchpad.net/~checkbox-dev/+archive/ppa

Running this version of checkbox should solve your problem, could you please confirm ?

Thanks

[Danny Hsu (dannyhsu)]

Hi Sylvain,

1) Update checkbox to 0.15+bzr1832+201211211750 and checkbox-certification to 0.15+bzr556+201211161747.
2) Copy the .checkbox which uploaded by Alfie to the home folder.
3) Execute the checkbox-oem-somerville-gtk.
4) Checkbox still crashed after select "Continue" or "Rerun".

Do we need use the new version of checkbox and checkbox-certification to do a new testing to prevent this bug? thanks.

[Sylvain Pineau (sylvain-pineau)]

camera/multiple-resolution-images generates ANSI char that are not escaped in the version available from the stable ppa.
Using the same .checkbox with recent version of checkbox will result in the same failure.

Sorry but consider this testrun lost.

I will start the process of updating the stable ppa to deliver this fix following samantha's validation procedure.
In the meantime, please install the version of the checkbox-devel ppa.

I'm going to set this bug fix committed now and released when the stable ppa will be updated.