Some skipped test cases will be back unexpectedly after reboot and choose "rerun last test"

[Po-Hsu Lin]

If you reboot the system and select "rerun last test" in canonical-certification-client, an already-skipped job will pop up, you have to skip that job again to access the last job

This issue could be easily reproduced:
1. Install 12.04.5 and test tools
2. Start testing, go through some tests, skip some of them
3. Close the canonical-certification-client, reboot
4. Open the tool again, select "rerun last test"
voilà

[Zygmunt Krynicki (zyga)]

Is this still happening Sylvain?

[Po-Hsu Lin (cypressyew)]

Yes,
reproduced today with
checkbox:
  Installed: 0.17.10+bzr2829+pkg77+legacy1~ubuntu14.04.1
  Candidate: 0.17.10+bzr2829+pkg77+legacy1~ubuntu14.04.1
  Version table:
 *** 0.17.10+bzr2829+pkg77+legacy1~ubuntu14.04.1 0
        500 http://ppa.launchpad.net/checkbox-dev/ppa/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status
     0.17.6-0ubuntu6 0
        500 http://us.archive.ubuntu.com/ubuntu/ trusty/universe amd64 Packages

plainbox:
  Installed: 0.17+bzr3448+pkg19~ubuntu14.04.1
  Candidate: 0.17+bzr3448+pkg19~ubuntu14.04.1
  Version table:
 *** 0.17+bzr3448+pkg19~ubuntu14.04.1 0
        500 http://ppa.launchpad.net/checkbox-dev/ppa/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status
     0.5.3-2 0
        500 http://us.archive.ubuntu.com/ubuntu/ trusty/universe amd64 Packages

but to be clarify, those already-skipped jobs are automatically skipped ones.
e.g. esata/remove, (I skipped the esata/insert test in the beginning)

[Sylvain Pineau (sylvain-pineau)]

OK, finally reproduced using the attached session where the expected job to be rerun is:

         "2013.com.canonical.certification::expresscard/verification" : "1ad4a0ccd00d04ff576da7655b982ecff9e26f4c825c7aa9d00d47cfdbd2b9be"

Taken from the session metadata:

      "metadata" : {
         "title" : "GuiEngine",
         "app_id" : "com.canonical.checkbox-gui",
         "running_job_name" : "/plainbox/job/1ad4a0ccd00d04ff576da7655b982ecff9e26f4c825c7aa9d00d47cfdbd2b9be",
         "app_blob" : [...]
         "flags" : [
            "incomplete"
         ]
      },