fs064 and fs039 are unstable - investigating deploy_freeipa

[Ronelle Landy]

periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master (and wallaby) and periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-wallaby ( and master)

hardly pass:

Example:

https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-wallaby&skip=0

The failure around 50-60 minutes is usually (as shown in log):

https://logserver.rdoproject.org/55/36255/135/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-wallaby/ce3136a/logs/supplemental/home/cloud-user/ipa_prep.sh.log.txt.gz

2022-09-18 00:53:56 | + sudo dnf install -yq ansible-core ansible-tripleo-ipa
2022-09-18 00:53:59 | Error: Error downloading packages:
2022-09-18 00:53:59 | ansible-macros-2021.1.2-2.el9s.noarch: Cannot download, all mirrors were already tried without success
2022-09-18 00:53:59 |

[Ronelle Landy (rlandy)]

Other logs:

https://logserver.rdoproject.org/83/43883/26/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-wallaby/8e0f44b/logs/supplemental/home/cloud-user/ipa_prep.sh.log.txt.gz

Or is if passed setup - then undercloud install fails:

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-wallaby/56afb83/job-output.txt

Investigating DNS forwarders here

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ci/+/858412

[Ronelle Landy (rlandy)]

Testing: https://review.opendev.org/c/openstack/tripleo-ci/+/858412

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-ci/+/858412
Committed: https://opendev.org/openstack/tripleo-ci/commit/b4858ba2ab2c54f955a2f3fabd5d703ccdc4dbd0
Submitter: "Zuul (22348)"
Branch: master

commit b4858ba2ab2c54f955a2f3fabd5d703ccdc4dbd0
Author: Ronelle Landy <email address hidden>
Date: Mon Sep 19 12:00:53 2022 -0400

    Switching to local nameservers on vexxhost

    vexxhost defaults were pointing to OpenDNS only.
    This patch adds the local nameservers so they
    are used as forwarders in IPA jobs.

    Change-Id: I1a9ea3b356a96e7608830f32097d24f5658d87c8
    Related-Bug: #1990086