Activity log for bug #1651503

Date Who What changed Old value New value Message
2016-12-20 16:12:10 Jeff Lane  bug added bug
2016-12-20 16:12:10 Jeff Lane  attachment added recovery-jobs.png https://bugs.launchpad.net/bugs/1651503/+attachment/4794378/+files/recovery-jobs.png
2016-12-20 16:12:45 Jeff Lane  description There are some recovery partition tests that have been recently added that are being executed automatically by checkbox regardless of the suite being chosen. Specifically, the following jobs are now appearing in all runs of canonical-certification-server: dell_bto_xml_attachment_json recovery_info_attachment_json These two are included as depends for miscellanea/submission_resources They are defined in submission.txt dell_bto_xml_attachment_json lists info/detect_dell_recovery as a depends recovery_info_attachment_json lists info/detect_recovery as a depends. Both info/detect_dell_recovery and info/detect_recovery are defined in info.txt. Both appear to be standard shell jobs. However, these are all being run as part of the server test suite and they shouldn't be. To recreate this, I can do the following: 1: Set up 16.04.x VM 2: add-apt-repository -u ppa:hardware-certification/public 3: apt install -y canonical-certification-server 4: run canonical-certification-server 5: pick a whitelist, any whitelist 6: on the Test Selection Screen, expand the Informational Tests category and see that these tests are listed as tests to be executed. These tests are NOT included in my whitelists For example, in my recreation, I chose the USB Only whitelist. That list does NOT call these recovery detection jobs, but they still appear in the Test Selection screen as shown in the attached screenshot. It's not a big deal, as they are not executed because the dell-recovery and ubuntu-recovery packages are not installed, but they should not be appearing in my test runs at all to begin with. root@ubuntu-2gb-nyc3-01:~# dpkg -l |grep plainbox-provider|awk '{print $2" " $3}' plainbox-provider-certification-server 0.30.0~ppa~ubuntu16.04.1 plainbox-provider-checkbox 0.33.0~ppa~ubuntu16.04.1 plainbox-provider-resource-generic 0.30.0~ppa~ubuntu16.04.1 There are some recovery partition tests that have been recently added that are being executed automatically by checkbox regardless of the suite being chosen. Specifically, the following jobs are now appearing in all runs of canonical-certification-server: info/detect_dell_recovery info/detect_recovery dell_bto_xml_attachment_json recovery_info_attachment_json These two are included as depends for miscellanea/submission_resources They are defined in submission.txt dell_bto_xml_attachment_json lists info/detect_dell_recovery as a depends recovery_info_attachment_json lists info/detect_recovery as a depends. Both info/detect_dell_recovery and info/detect_recovery are defined in info.txt. Both appear to be standard shell jobs. However, these are all being run as part of the server test suite and they shouldn't be. To recreate this, I can do the following: 1: Set up 16.04.x VM 2: add-apt-repository -u ppa:hardware-certification/public 3: apt install -y canonical-certification-server 4: run canonical-certification-server 5: pick a whitelist, any whitelist 6: on the Test Selection Screen, expand the Informational Tests category and see that these tests are listed as tests to be executed. These tests are NOT included in my whitelists For example, in my recreation, I chose the USB Only whitelist. That list does NOT call these recovery detection jobs, but they still appear in the Test Selection screen as shown in the attached screenshot. It's not a big deal, as they are not executed because the dell-recovery and ubuntu-recovery packages are not installed, but they should not be appearing in my test runs at all to begin with. root@ubuntu-2gb-nyc3-01:~# dpkg -l |grep plainbox-provider|awk '{print $2" " $3}' plainbox-provider-certification-server 0.30.0~ppa~ubuntu16.04.1 plainbox-provider-checkbox 0.33.0~ppa~ubuntu16.04.1 plainbox-provider-resource-generic 0.30.0~ppa~ubuntu16.04.1
2016-12-20 16:13:01 Jeff Lane  description There are some recovery partition tests that have been recently added that are being executed automatically by checkbox regardless of the suite being chosen. Specifically, the following jobs are now appearing in all runs of canonical-certification-server: info/detect_dell_recovery info/detect_recovery dell_bto_xml_attachment_json recovery_info_attachment_json These two are included as depends for miscellanea/submission_resources They are defined in submission.txt dell_bto_xml_attachment_json lists info/detect_dell_recovery as a depends recovery_info_attachment_json lists info/detect_recovery as a depends. Both info/detect_dell_recovery and info/detect_recovery are defined in info.txt. Both appear to be standard shell jobs. However, these are all being run as part of the server test suite and they shouldn't be. To recreate this, I can do the following: 1: Set up 16.04.x VM 2: add-apt-repository -u ppa:hardware-certification/public 3: apt install -y canonical-certification-server 4: run canonical-certification-server 5: pick a whitelist, any whitelist 6: on the Test Selection Screen, expand the Informational Tests category and see that these tests are listed as tests to be executed. These tests are NOT included in my whitelists For example, in my recreation, I chose the USB Only whitelist. That list does NOT call these recovery detection jobs, but they still appear in the Test Selection screen as shown in the attached screenshot. It's not a big deal, as they are not executed because the dell-recovery and ubuntu-recovery packages are not installed, but they should not be appearing in my test runs at all to begin with. root@ubuntu-2gb-nyc3-01:~# dpkg -l |grep plainbox-provider|awk '{print $2" " $3}' plainbox-provider-certification-server 0.30.0~ppa~ubuntu16.04.1 plainbox-provider-checkbox 0.33.0~ppa~ubuntu16.04.1 plainbox-provider-resource-generic 0.30.0~ppa~ubuntu16.04.1 There are some recovery partition tests that have been recently added that are being executed automatically by checkbox regardless of the suite being chosen. Specifically, the following jobs are now appearing in all runs of canonical-certification-server: info/detect_dell_recovery info/detect_recovery dell_bto_xml_attachment_json recovery_info_attachment_json These last two are included as depends for miscellanea/submission_resources They are defined in submission.txt dell_bto_xml_attachment_json lists info/detect_dell_recovery as a depends recovery_info_attachment_json lists info/detect_recovery as a depends. Both info/detect_dell_recovery and info/detect_recovery are defined in info.txt. Both appear to be standard shell jobs. However, these are all being run as part of the server test suite and they shouldn't be. To recreate this, I can do the following: 1: Set up 16.04.x VM 2: add-apt-repository -u ppa:hardware-certification/public 3: apt install -y canonical-certification-server 4: run canonical-certification-server 5: pick a whitelist, any whitelist 6: on the Test Selection Screen, expand the Informational Tests category and see that these tests are listed as tests to be executed. These tests are NOT included in my whitelists For example, in my recreation, I chose the USB Only whitelist. That list does NOT call these recovery detection jobs, but they still appear in the Test Selection screen as shown in the attached screenshot. It's not a big deal, as they are not executed because the dell-recovery and ubuntu-recovery packages are not installed, but they should not be appearing in my test runs at all to begin with. root@ubuntu-2gb-nyc3-01:~# dpkg -l |grep plainbox-provider|awk '{print $2" " $3}' plainbox-provider-certification-server 0.30.0~ppa~ubuntu16.04.1 plainbox-provider-checkbox 0.33.0~ppa~ubuntu16.04.1 plainbox-provider-resource-generic 0.30.0~ppa~ubuntu16.04.1
2016-12-20 19:33:16 Maciej Kisielewski plainbox-provider-checkbox: status New In Progress
2016-12-20 19:33:19 Maciej Kisielewski plainbox-provider-checkbox: assignee Maciej Kisielewski (kissiel)
2016-12-20 19:47:10 Maciej Kisielewski plainbox-provider-checkbox: assignee Maciej Kisielewski (kissiel) Sylvain Pineau (sylvain-pineau)
2016-12-20 19:47:15 Maciej Kisielewski plainbox-provider-checkbox: status In Progress Confirmed
2017-01-10 05:23:33 Jerry Kao tags hwcert-server ce-qa-concern hwcert-server
2017-04-28 13:54:38 Launchpad Janitor merge proposal linked https://code.launchpad.net/~bladernr/plainbox-provider-certification-server/+git/plainbox-provider-certification-server/+merge/323388
2017-04-28 14:53:34 Jeff Lane  plainbox-provider-checkbox: importance Undecided Medium
2017-04-28 14:54:19 Jeff Lane  plainbox-provider-checkbox: milestone 0.36.0
2017-05-16 11:57:55 Sylvain Pineau plainbox-provider-checkbox: milestone 0.36.0
2017-07-13 11:09:34 Sylvain Pineau plainbox-provider-checkbox: status Confirmed Triaged
2017-09-19 12:18:49 Sylvain Pineau plainbox-provider-checkbox: milestone 0.40.0
2017-09-19 12:18:53 Sylvain Pineau plainbox-provider-checkbox: status Triaged In Progress
2017-09-26 12:16:35 Sylvain Pineau plainbox-provider-checkbox: status In Progress Fix Committed
2017-10-24 14:27:17 Sylvain Pineau plainbox-provider-checkbox: status Fix Committed Fix Released