Review Stella provider and some questions

Bug #1311518 reported by Betty Lin on 2014-04-23

This bug report was converted into a question: question #247493: Review Stella provider and some questions.

6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Checkbox
Undecided
Sylvain Pineau

Bug Description

Albert already help to build plainbox-provider-oem-stella base on:
https://code.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox

I install the provider and have some questions:
1. Could all project (sutton, hp, dell) use the same provider base and build different provider for different project and put to different ppa location?
2. In "Run Manger", I can not see the sub test case under https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/jobs/stella/ and all stella test case did not run
3. If I close "Run manger" and then re-start it and select another whitelist. does the previous test result will be deleted? or the test result will be overwritten?
4. Where is the test result? (when we use checkbox, it is under ./home/usr/.checkbox)
5. We use lazybone to install checkbox before, could we still use lazybone by modifying the config file to install plainbox?

Changed in checkbox:
assignee: nobody → Sylvain Pineau (sylvain-pineau)
Zygmunt Krynicki (zyga) wrote :

 4. Where is the test result? (when we use checkbox, it is under ./home/usr/.checkbox)

Test result location is defined by the launcher (typically it is /tmp/submission.xml but it can be anything you want). Have a look at the laucher source code (/usr/bin/canonical-certification-client is a good example). Also look at https://code.launchpad.net/~sylvain-pineau/checkbox/ui_profiles/+merge/211490 for a short list of available launcher settings.

Internal data is stored in ~/.cache/plainbox/sessions/ but you should not typically need to use it directly.

Zygmunt Krynicki (zyga) wrote :

 3. If I close "Run manger" and then re-start it and select another whitelist. does the previous test result will be deleted? or the test result will be overwritten?

Currently we delete the previous testing session when you choose to start a new session. Technically this is not required and plainbox can store arbitrarily many sessions at the same time, tracking which were exported to a file, sent somewhere or ran all the desired tests (completed). Plainbox also knows which application created each session. Currently this data is not used in any way.

Zygmunt Krynicki (zyga) wrote :

 1. Could all project (sutton, hp, dell) use the same provider base and build different provider for different project and put to different ppa location?

You could use stable checkbox/plainbox/provider releases from one PPA and put other providers (and launchers) into either one big ppa or many small PPAs. You have total freedom in how you want to compose the final solution.

Zygmunt Krynicki (zyga) wrote :

 2. In "Run Manger", I can not see the sub test case under https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/jobs/stella/ and all stella test case did not run

https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/ is clearly wrong. You need to have all job files (either .txt or .txt.in) inside the jobs/ directory (not in jobs/something/). Run ./manage info and look at the list of jobs printed. Tweak the layout until you can see all your jobs by running 'manage.py info'

Zygmunt Krynicki (zyga) wrote :

5. We use lazybone to install checkbox before, could we still use lazybone by modifying the config file to install plainbox?

Perhaps, I don't know anything about lazybone. If it can enable a PPA and install packages then the answer is yes.

Zygmunt Krynicki (zyga) wrote :

 2. In "Run Manger", I can not see the sub test case under https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/jobs/stella/ and all stella test case did not run

With all the providers installed please also install plainbox (the package) and run:

$ plainbox dev analyze --print-desired-job-list --print-run-list -w /path/to/the/whitelist/you/want/to/run.whitelist

And look at the output. Check if there are any jobs you expected to see but aren't there. Currently we don't have any development aids that would find typos and other simple mistakes. This is tracked as bug https://bugs.launchpad.net/plainbox/+bug/1262251

Zygmunt Krynicki (zyga) wrote :

This is a support question so let's convert it to one

Changed in checkbox:
status: New → Invalid
tags: added: ce-qa-providers
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers

Related questions