Comment 19 for bug 2000226

Hello All,

We tried pinning kernel to 5.14.0-210.el9.x86_64 (patch [1])and it helped.
Affected kernel version: 5.14.0-214*, node provisioning passed for multiple jobs with older kernel, results at [2].

Observation:

Vexx mirror and mirror.stream.centos.org are currently not in sync and have different kernel version available.
Because of our job wrong configuration, we are leaking content from mirror.stream.centos.org and getting latest kernel.

1) Component line job, centos.repo is not disabled and result in latest kernel leak.

https://logserver.rdoproject.org/openstack-component-baremetal/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-baremetal-wallaby/1cd7430/logs/undercloud/home/zuul/build.log.txt.gz
~~~
2022-12-27 00:54:07.471 | kernel x86_64 5.14.0-214.el9 baseos 2.8 M
~~~

Fix: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/868677

2) Integration line job:-

Overcloud nodes are wrongly using mirror.stream.centos.org instead of local vexx mirror and pulling latest kernel during modify-image role.

https://logserver.rdoproject.org/37/28537/63/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-zed/7dca9fd/logs/overcloud-controller-0/etc/yum.repos.d/quickstart-centos-appstreams.repo.txt.gz

baseurl=http://mirror.stream.centos.org/9-stream/AppStream/x86_64/os/

older kernel works, but i wonder if we are hitting this issue because we are mixing content(and this is not a kernel bug), instead of excluding kernel maybe we should fix the repo to use correct local mirror.

I will continue checking the baseurl for integration job tomorrow.

[1] https://review.opendev.org/c/openstack/tripleo-quickstart/+/868605/6/config/release/tripleo-ci/CentOS-9/master.yml
[2] https://review.rdoproject.org/r/c/testproject/+/28537/69#message-ab5d371a81952bbc0f65beffc2fd40afa1bd6cc2