Pipeline does not publish logs of packages that failed to build

[Dostoievski Albino Batista]

Brief Description
-----------------

sufficient logs need to be published to mirror.starlingx.windriver.com to allow debugging of a build problem. The current publish-logs step of the jenkins pipeline only concerns itself with jenkins logs. It fails to publish logs from stx build steps, nor the logs for failed packages.

THe failed package logs are of great interest: e.g. for a recent build failure of grub2, in the directory ...
/localdisk/loadbuild/jenkins/f-bookworm-debian/20240611T172813Z/localdisk/loadbuild/jenkins/f-bookworm-debian/std/grub2

are found logs...
grub2.log
grub2_2.06-1.stx.8_source.buildinfo
grub2_2.06-1.stx.8_amd64.build

Severity
-----------------
Minor

Steps to Reproduce
-----------------
N/A

Expected Behavior
-----------------
Sufficient logs are published such that direct access to the build server is NOT required to debug the issue

Actual Behavior
-----------------
Insufficient logs to fully debug. We might know what package failed, but not why.

Reproducibility
-----------------
100%

System Configuration
-----------------
N/A

Branch/Pull Time/Commit
-----------------------
master / 2024 Jun 27

Last Pass
-----------------
N/A

Timestamp/Logs
-----------------
N/A

Test Activity
-----------------
Build

Workaround
-----------------
Describe workaround if available

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/922928

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/922928
Committed: https://opendev.org/starlingx/jenkins-pipelines/commit/17314970c08c3a1f49af40ff2a5e9c799431d6bf
Submitter: "Zuul (22348)"
Branch: master

commit 17314970c08c3a1f49af40ff2a5e9c799431d6bf
Author: suyash <email address hidden>
Date: Thu Jun 27 13:49:33 2024 +0530

    Added publish-stx-logs.sh script to pipeline.

    We need to publish sufficient logs to mirror.starlingx.windriver.com
    to allow debugging of a build problem. The current publish-logs step of
    jenkins pipeline only concerns itself with jenkins logs.
    This new script will be executed as part of publish-logs step.

    Test-Plan:
    PASS - Run jenkins job to verify publish-log part.
    PASS - Check if package log file exists.

    Closes-bug: 2071355
    Change-Id: I0c884e4817134e7b11dc13a0364ba90af18a4d5d
    Signed-off-by: suyash <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/923241

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/923241
Committed: https://opendev.org/starlingx/jenkins-pipelines/commit/c8e6108929d90bdd4a5b21b8574e20e8e612e606
Submitter: "Zuul (22348)"
Branch: master

commit c8e6108929d90bdd4a5b21b8574e20e8e612e606
Author: suyash <email address hidden>
Date: Tue Jul 2 19:13:46 2024 +0530

    Modified error message and exit in publish-stx-log.sh

    Error message was not much clear and script exited if std or rt folder
    was not found. changed exit to return and added more text in error message
    To make it understandable.

    Test-Plan:
    PASS - Run jenkins job to verify publish-log part.
    PASS - Check if package log file exists.

    Closes-bug: 2071355
    Change-Id: Ib59cfadf3dccb366c90b7c21e71160035dc2b4d1
    Signed-off-by: suyash <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/923365

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/923365
Committed: https://opendev.org/starlingx/jenkins-pipelines/commit/380eb290872c1fe9a17beca0141cbd0fb150c9ef
Submitter: "Zuul (22348)"
Branch: master

commit 380eb290872c1fe9a17beca0141cbd0fb150c9ef
Author: suyash <email address hidden>
Date: Wed Jul 3 13:31:03 2024 +0530

    Handling of Env variable in publish-stx-log.sh

    Improved the condition to handle environment variable in IF condition
    just to avoid failure in case environment variable is unset.

    Test-Plan:
    PASS - Run jenkins job to verify publish-log part.
    PASS - Check if package log file exists.

    Closes-bug: 2071355
    Change-Id: Ic37bafd2388c448fc6633b9047f801b4305375a7
    Signed-off-by: suyash <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/923572

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/jenkins-pipelines/+/923572
Committed: https://opendev.org/starlingx/jenkins-pipelines/commit/928e9a9a77c4e03b0ddea45b57a8608f40315c93
Submitter: "Zuul (22348)"
Branch: master

commit 928e9a9a77c4e03b0ddea45b57a8608f40315c93
Author: suyash <email address hidden>
Date: Fri Jul 5 17:47:34 2024 +0530

    Added BUILD_RT Parameter in publish-log.pipeline

    To publish realtime log to mirror.starlingx.windriver.com.
    BUILD_RT information is required, so adding this parameter.

    Test-Plan:
    PASS - Run jenkins job to verify publish-log part.
    PASS - Check if package log file exists.

    Closes-bug: 2071355
    Change-Id: Ibb185df1b4c6ad7f5f488062f4f489744a03a6b8
    Signed-off-by: suyash <email address hidden>