Featureset39 train fails with libibverbs-44.0-2.el8.1.x86_64.rpm: signature hdr data: BAD, no. of bytes(15176) out of range

[Sandeep Yadav]

Description:

fs039 train fails with libibverbs-44.0-2.el8.1.x86_64.rpm: signature hdr data: BAD, no. of bytes(15176) out of range

https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-train/f34c9c8/job-output.txt

~~~
2023-03-20 11:09:31.352594 | primary | PLAY RECAP *********************************************************************
2023-03-20 11:09:31.352657 | primary | supplemental : ok=25 changed=3 unreachable=0 failed=1 skipped=16 rescued=0 ignored=0
2023-03-20 11:09:31.352697 | primary | undercloud : ok=15 changed=6 unreachable=0 failed=0 skipped=16 rescued=0 ignored=0
.
.

03-20 13:00:42 | (361/361): linux-firmware-20230217-113.git83f1d 159 MB/s | 263 MB 00:01 ", "2023-03-20 13:00:42 | --------------------------------------------------------------------------------", "2023-03-20 13:00:42 | Total 48 MB/s | 569 MB 00:11 ", "2023-03-20 13:00:42 | Running transaction check", "2023-03-20 13:00:42 | error: /var/cache/dnf/quickstart-centos-base-9719b577bcc9988d/packages/libibverbs-44.0-2.el8.1.x86_64.rpm: signature hdr data: BAD, no. of bytes(15176) out of range", "2023-03-20 13:00:42 | The downloaded packages were saved in cache until the next successful transaction.", "2023-03-20 13:00:42 | You can remove cached packages by executing 'dnf clean packages'.", "2023-03-20 13:00:42 | Error: error reading package header: '/var/cache/dnf/quickstart-centos-base-9719b577bcc9988d/packages/libibverbs-44.0-2.el8.1.x86_64.rpm'"]}
~~~

Issue started on 17th March as per build history: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-train&skip=0

This issue seems related to https://bugzilla.redhat.com/show_bug.cgi?id=1918777 , Issue was fixed in rpm-4.14.3-11.el8 as per fixed in release of the bug.

Supplemental node:
https://sf.hosted.upshift.rdu2.redhat.com/logs/78/47278/18/check-rdo/periodic-tripleo-ci-cent[…]lemental/var/log/extra/package-list-installed.txt.gz
~~~
rpm.x86_64 4.14.2-25.el8 @anaconda
~~~

primary node:
https://sf.hosted.upshift.rdu2.redhat.com/logs/78/47278/18/check-rdo/periodic-tripleo-ci-cent[…]dercloud/var/log/extra/package-list-installed.txt.gz
~~~
rpm.x86_64 4.14.3-26.el8 @baseos
~~~

We need to check why rpm version is older on supplemental node and bump that.

We hit a similiar bug recently: https://bugs.launchpad.net/tripleo/+bug/2011805, where bumping the ubi to 8.7 fixed the issue.