undercloud vm not leasing ip address in c9 minimal libvirt deploy

[Rafael Castillo]

Affecting tripleo-quickstart-promote-master-centos9-current-tripleo-delorean-minimal on centosci.

Logs:
https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-master-centos9-current-tripleo-delorean-minimal/27/consoleText

I was able to reproduce locally on a pair of vms with:
bash ci-scripts/full-deploy.sh master delorean minimal promote

And environment:
VIRTHOST=192.168.122.91
VIRTHOST_KEY=$(cat ~/.ssh/id_rsa.pub)
DISTRO_PATH=CentOS-9
OPT_ENVIRONMENT=/home/stack/tripleo-quickstart/config/environments/ci_centos_libvirt.yml
CI_ENV=centosci
LOCATION=current-tripleo

[Rafael Castillo (rafaelcastillo)]

Poking around the undercloud vm:

[root@undercloud ~]# nmcli con
NAME UUID TYPE DEVICE
ens3 e6701eae-b871-4862-aedf-112626424326 ethernet --
[root@undercloud ~]# nmcli device
DEVICE TYPE STATE CONNECTION
eth0 ethernet disconnected --
eth1 ethernet disconnected --
lo loopback unmanaged --
[root@undercloud ~]# nmcli con up ens3
Error: Connection activation failed: No suitable device found for this connection (device eth0 not available because profile is not compatible with device (mismatching interface name)).
[root@undercloud ~]# nmcli device up eth0
Device 'eth0' successfully activated with 'c81cbd6d-7570-4383-9d23-48bd10fc8a7d'.
[root@undercloud ~]# nmcli con
NAME UUID TYPE DEVICE
eth0 c81cbd6d-7570-4383-9d23-48bd10fc8a7d ethernet eth0
ens3 e6701eae-b871-4862-aedf-112626424326 ethernet --
[root@undercloud ~]# ip addr show eth0
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether 00:88:20:5b:ce:e1 brd ff:ff:ff:ff:ff:ff
    altname enp0s3
    altname ens3
    inet 192.168.23.30/24 brd 192.168.23.255 scope global dynamic noprefixroute eth0
       valid_lft 3505sec preferred_lft 3505sec
    inet6 fe80::8534:9a97:d31d:6966/64 scope link noprefixroute
       valid_lft forever preferred_lft forever

[Cédric Jeanneret (cjeanner)]

Hello,

Would you be able to provide:
- build date of the used image (I guess it's latest?)
- a bit more data out of nmcli:

nmcli con show ens3
nmcli device show eth0
nmcli device show eth1

I'm pretty sure it's an issue in the image itself, with the mismatching interface name (ens3 vs eth0).

[Rafael Castillo (rafaelcastillo)]

Jenkins job is failing with this image https://images.rdoproject.org/centos9/master/rdo_trunk/9f64d34fd96e599e2c256b3e7b8ad189/overcloud-full.tar

nmcli con show ens3
https://paste.opendev.org/show/bRAYcBwu8y6ucTt86r3S/

nmcli con show eth0
GENERAL.DEVICE: eth0
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:88:20:5B:CE:E1
GENERAL.MTU: 1500
GENERAL.STATE: 30 (disconnected)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
WIRED-PROPERTIES.CARRIER: on
IP4.GATEWAY: --
IP6.GATEWAY: --

nmcli con show eth1
GENERAL.DEVICE: eth1
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:88:20:5B:CE:DF
GENERAL.MTU: 1500
GENERAL.STATE: 30 (disconnected)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
WIRED-PROPERTIES.CARRIER: on
IP4.GATEWAY: --
IP6.GATEWAY: --

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-quickstart/+/831157

[OpenStack Infra (hudson-openstack)]

Change abandoned by "yatin <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/tripleo-quickstart/+/830870
Reason: Need to send seperate patch

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-quickstart/+/831157
Committed: https://opendev.org/openstack/tripleo-quickstart/commit/33ea54f0c33610b8b7c28fcf1ff5b6a54256a084
Submitter: "Zuul (22348)"
Branch: master

commit 33ea54f0c33610b8b7c28fcf1ff5b6a54256a084
Author: Rafael Castillo <email address hidden>
Date: Thu Feb 24 09:43:46 2022 -0700

    Ensure ifcfg-eth0 script exists for all centos releases

    Similar to [0], this ensures eth0 is configured for converted overcloud
    images.

    Posted with new change-id from original patch at [1] as it exceeded
    the allowed number of updates.

    [0] https://review.opendev.org/c/openstack/tripleo-quickstart/+/799574
    [1] https://review.opendev.org/c/openstack/tripleo-quickstart/+/830870

    Closes-Bug: #1962178
    Change-Id: Icb0528082f695e6334aff282530b6e9065374a0b