Remote subcloud install fails due to an error to communicate with kernel device-mapper driver (rt-kernel)

[Kyle MacLeod]

*+Brief Description+*

Subclouds are failing to be installed due to initrd issues with patched system controller

error:

[ 32.Download kickstart file [file:///kickstart/miniboot.cfg] failed
Parse Kickstart [file:///kickstart/miniboot.cfg] failed

[ 53.028505] sysrq: Resetting

Notes:
 * OAM IP is reachable
 * BMC IP is reachable

*+Severity+*

<Critical: System/Feature is not usable after the defect>

*+Steps to Reproduce+*

install subclouds

*+Expected Behavior+*

the subclouds should be installed successfully

*+Actual Behavior+*

State what is the actual behavior

*+Reproducibility+*

100% reproducible

*+System Configuration+*

2 subclouds

Patched system controller

*+Timestamp/Logs+*

*+Alarms+*

no alarms

*+Test Activity+*

install lab

*+Workaround+*

no workarounds

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/utilities/+/899432

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/utilities/+/899432
Committed: https://opendev.org/starlingx/utilities/commit/49478c3526cd52c4bbf9351398bfcf054fb4ac4d
Submitter: "Zuul (22348)"
Branch: master

commit 49478c3526cd52c4bbf9351398bfcf054fb4ac4d
Author: Kyle MacLeod <email address hidden>
Date: Thu Oct 26 16:36:34 2023 -0400

    Always use initrd-mini extracted from ostree of imported ISO

    This commit fixes subcloud installation issues where the
    /var/miniboot/initrd-mini becomes out of sync with the kernel of the
    load-imported ISO.

    The gen-bootloader-iso.sh script builds the miniboot ISO. Prior to this
    fix, it was always taking the initrd from /var/miniboot/initrd-mini.
    This fix changes the approach: we now always extract the
    initrd-mini{,sig} files from within the ostree_repo inside the
    load-imported ISO file. Since the kernel is also taken from the
    load-imported ISO, this fix ensures that the two will always be in
    alignment.

    The fix is to always use the initrd-mini extracted from within the
    ostree_repo of the load-imported ISO. We use ostree 'cat' to pull the
    initrd-mini and .sig files from the mounted ISO. These are included in
    the miniboot bootimage.iso

    Note: the /var/miniboot/initrd-mini{,sig} files are now never used from
    the system controller filesystem (though they will be present since they
    are put there by the initial ostree deployment). We always extract these
    from ostree_repo inside the load-imported ISO.

    Test Plan:
    PASS:
    - Use load-import to import an ISO with an updated kernel from the
      current system controller installation.
        - Verify that the initrd-mini and .sig are properly extracted and
          used for the miniboot bootimage.iso
        - Verify that the subcloud boots properly and installation is
          successful
        - Verify for both RT and non-RT kernel subcloud install values
    - Repeat above test for previous Debian release (this commit
      is not applicable for previous CentOS releases)

    Closes-Bug: 2041433

    Signed-off-by: Kyle MacLeod <email address hidden>
    Change-Id: I7503cec096ea02c06458e87f476b16e614772536