[testrail] Add links to bugs for 'blocked' tests

[Artem Panchenko]

In order to generate complete statistics for SWARM blockers we should copy links to bugs from upstream 'failed' cases to appropriate downstream 'blocked' cases. Since links to bugs are manually added by engineers during a day after nightly tests, it sounds reasonable to perform links copying before statistics generation in 'X.X.swarm.statistic' Jenkins job.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/267241

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/267241
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=5a6cc4df1ee6d4d2e016482ce6269baa8b14933f
Submitter: Jenkins
Branch: master

commit 5a6cc4df1ee6d4d2e016482ce6269baa8b14933f
Author: Artem Panchenko <email address hidden>
Date: Thu Jan 14 02:06:45 2016 +0200

    Attach links to bugs for blocked tests results

    Create a separate script for test plan bugs statistics
    generation which can:

     * attach (copy from upstream tests results) links to
       blocked automatic tests
     * gather stats (attached bugs) for all test runs in
       test plan
     * follow bugs "duplication chains" and report about
       original one (not its closed duplicates)
     * save statistics to file in JSON or HTML format for
       furter processing
     * publish statistics to TestRail into test plan
       description and update it (replace) in the future

    Change-Id: I23389146a685d77960165ea5b91cc11696729ffc
    Closes-bug: #1533196

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/268703

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/268703
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=c51dee0034894ce1d6f22ba300f06b88cd39fe8d
Submitter: Jenkins
Branch: stable/8.0

commit c51dee0034894ce1d6f22ba300f06b88cd39fe8d
Author: Artem Panchenko <email address hidden>
Date: Thu Jan 14 02:06:45 2016 +0200

    Attach links to bugs for blocked tests results

    Create a separate script for test plan bugs statistics
    generation which can:

     * attach (copy from upstream tests results) links to
       blocked automatic tests
     * gather stats (attached bugs) for all test runs in
       test plan
     * follow bugs "duplication chains" and report about
       original one (not its closed duplicates)
     * save statistics to file in JSON or HTML format for
       furter processing
     * publish statistics to TestRail into test plan
       description and update it (replace) in the future

    Change-Id: I23389146a685d77960165ea5b91cc11696729ffc
    Closes-bug: #1533196
    (cherry picked from commit 5a6cc4df1ee6d4d2e016482ce6269baa8b14933f)

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/273269

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: master
Change author: Artem Panchenko <email address hidden>
Review: https://review.fuel-infra.org/16503

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/273269
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=dfefe48710871e90a0000fd8a12cae27a9d9eed1
Submitter: Jenkins
Branch: master

commit dfefe48710871e90a0000fd8a12cae27a9d9eed1
Author: Artem Panchenko <email address hidden>
Date: Thu Jan 28 00:34:56 2016 +0200

    Added few more options to the statistics generator

    Added possibility to create reports (html or json)
    for each test run in test plan separately (-s option).
    Also currently it's possible to specify few test runs
    IDs for processing (previously only one ID was
    allowed).

    Change-Id: I71c8f1921d121870cd8dd7becae929962a483a0a
    Partial-bug: #1533196

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/275211

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/16503
Submitter: Aleksandra Fedorova <email address hidden>
Branch: master

Commit: 1dc8b3711938b5a965f8579c13e4bd1304bcefb0
Author: Artem Panchenko <email address hidden>
Date: Tue Feb 2 13:25:04 2016

Create new job for TestRail bugs stats generation

Create new job 'testrail.bugs.statistics' which can
be run manually against any test plan in TestRail in
order to collect attached bugs and create reports.

Also use new separate builder for SWARM statistics
generation.

Change-Id: I0fe729bba5c76786e98a011851c8a1a566f1435a
Partial-bug: #1533196

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/275211
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=23dffa28b87391a5b38b43e570b99b3b60997278
Submitter: Jenkins
Branch: stable/8.0

commit 23dffa28b87391a5b38b43e570b99b3b60997278
Author: Artem Panchenko <email address hidden>
Date: Thu Jan 28 00:34:56 2016 +0200

    Added few more options to the statistics generator

    Added possibility to create reports (html or json)
    for each test run in test plan separately (-s option).
    Also currently it's possible to specify few test runs
    IDs for processing (previously only one ID was
    allowed).

    Change-Id: I71c8f1921d121870cd8dd7becae929962a483a0a
    Partial-bug: #1533196
    (cherry picked from commit dfefe48710871e90a0000fd8a12cae27a9d9eed1)

[Fuel Devops McRobotson (fuel-devops-robot)]

Related fix proposed to branch: master
Change author: Artem Panchenko <email address hidden>
Review: https://review.fuel-infra.org/16637

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/16637
Submitter: Aleksandra Fedorova <email address hidden>
Branch: master

Commit: b69eb920a29c395945c944f195117fe604033b50
Author: Artem Panchenko <email address hidden>
Date: Tue Feb 2 22:48:38 2016

Rename BUILD_NUMBER to TEST_RUNNER_BUILD_NUMBER

The variable $BUILD_NUMBER is always set by Jenkins
(current build number), so it can't be used for setting
custom parameter.
By default $TEST_RUNNER_BUILD_NUMBER is undefined and
'generate_statistics.py' script takes latest build of
$TEST_RUNNER_JOB_NAME job.

Change-Id: I4c736212bb8b05e033807d4f171e418aa02157a0
Related-bug: #1533196

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/281318

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/281318
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=c33f7a00e112412c171f7916ed35beeb9f094afb
Submitter: Jenkins
Branch: master

commit c33f7a00e112412c171f7916ed35beeb9f094afb
Author: Artem Panchenko <email address hidden>
Date: Wed Feb 17 16:12:07 2016 +0200

    Count failed and blocked test cases separately

    In order to increase verbosity of bugs statistics
    reports, count separately failed and blocked results
    for tests cases. Put the numbers into different columns.

    Change-Id: Idad0e93dc4439f27f4a23cd50df9cea4e49cd58f
    Partial-bug: #1533196

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/281537

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/281537
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=d99f7428e6ebd9dfe77aceeb226b3b710e5b2b2a
Submitter: Jenkins
Branch: stable/8.0

commit d99f7428e6ebd9dfe77aceeb226b3b710e5b2b2a
Author: Artem Panchenko <email address hidden>
Date: Wed Feb 17 16:12:07 2016 +0200

    Count failed and blocked test cases separately

    In order to increase verbosity of bugs statistics
    reports, count separately failed and blocked results
    for tests cases. Put the numbers into different columns.

    Change-Id: Idad0e93dc4439f27f4a23cd50df9cea4e49cd58f
    Partial-bug: #1533196
    (cherry picked from commit c33f7a00e112412c171f7916ed35beeb9f094afb)

[Tatyanka (tatyana-leontovich)]

Works perfectly! Thank you Artem!