Run nailgun performance tests on every commit

[Maciej Kwiek]

This job is stable now: https://fuel-jenkins.mirantis.com/job/nailgun_performance_tests/ , so performance tests can be included in build verification process.

[Nastya Urlapova (aurlapova)]

Maciej, thanks for your suggestion. Could you explain why is not enough if this tests will be run only for nailgun's?

[Maciej Kwiek (maciej-iai)]

These tests are run two times a day now in a separate jenkins job, and only for master branch, so we will know about change that is breaking performance after the change is merged.

Including them in BVT would help ensure that nailgun performance on tested build is not broken.

[Nastya Urlapova (aurlapova)]

@Tomasz, some time ago you has started to research this topic. could you provide a status of your discussion with developers.

[Tomasz 'Zen' Napierala (tzn)]

We think we should include them in BVT, but it's more your judgment to decide if we can afford in terms ofBVT execution time

[Nastya Urlapova (aurlapova)]

Where is I can find results of these tests, how we can integrate performance service into our infra (it is some outstanding server, yep?), why you don't want to include this suite to job against each review in fuel-web.

[Maciej Kwiek (maciej-iai)]

I guess you mean this service:

http://fuel-gauge.mirantis.com

this is a tool that will show you execution time charts for individual tests and general trend. It uses artifacts from jenkins job and visualises them.

But this is only the visualisation, including them to bvt would probably not be valuable.

Integrating it to infra would probably mean running these tests in the same manner as in jenkins job listed in bug description and using the same status code and artifacts (or maybe there is a way to use existing job as sub-task in bvt?).

[Nastya Urlapova (aurlapova)]

I am not sure, that we need to include performance testing to BVT.

[Tatyanka (tatyana-leontovich)]

+ 1 to Nastya, It would be cool to run those tests for every patch in nailgun(like usual nailgun unit tests). Si that we can get a quick feedback about nailgun performance degradation and will know what the patch leads to it

[Tatyanka (tatyana-leontovich)]

Guys why this issue is on QA team - if you need to add tests execution on daily basis on CI you should discuss it with devops team

[Igor Shishkin (teran)]

Assigning to proper team because of task purpose.

[Igor Belikov (ibelikov)]

This was fixed a long time ago in https://review.fuel-infra.org/#/c/5207/
Job https://ci.fuel-infra.org/job/verify-nailgun_performance_tests/ runs on every commit to fuel-web repo