Debian Redfish Subcloud is failing to unlock

[Kyle MacLeod]

Brief Description
-----------------

Remote install and bootstrap of simplex subcloudinitial unlock post deployment failed. The reboot did not go far enough to start sm which in turn starts other services.

A couple of other observations:

- /var/log/lat directory which contains install output does not exist post subcloud install

Severity
--------

Critical

Steps to Reproduce
------------------

- Install System Controller
- Deploy Subcloud on hardware subcloud using redfish

Expected Behavior
------------------

Subcloud deployed and unlocked.

Actual Behavior
---------------

Subcloud controller-0 is failing to unlock. The last known working load for Debian is Sept. 26th

Reproducibility
---------------

Very reproducible.

System Configuration
--------------------

DC

Debian 22.12 - 2022-10-04_18-00-11

Last Pass
---------

First time on Debian.

Timestamp/Logs
--------------

Alarms
------

NA

Test Activity
-------------

Debian Testing

Workaround
----------

NA

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/metal/+/861015

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/metal/+/861015
Committed: https://opendev.org/starlingx/metal/commit/08a16fe8a2324c7237a312d09fd9ea01e4f201da
Submitter: "Zuul (22348)"
Branch: master

commit 08a16fe8a2324c7237a312d09fd9ea01e4f201da
Author: Kyle MacLeod <email address hidden>
Date: Tue Oct 11 20:35:56 2022 -0400

    Fix hardware subcloud unlock using redfish deployment

    Bring miniboot.cfg up to date with recent changes to kickstart.cfg

    Other changes:
    - Minor tweaks to logging of major stages (make consistent, for grep)
    - Ensure logs are copied into /var/log/lat

    Since most changes are made to miniboot.cfg, the most efficient
    way to review these changes is via side-by-side diff between
    miniboot.cfg to kickstart.cfg

    Closes-Bug: 1992534

    Test Plan:

    PASS: Verify subcloud add using redfish:
    - subcloud is installed, bootstrapped, and comes online
      after being unlocked
        - NOTE: test was done on hardware requiring workaround for n3000
          FPGA reset in puppet, but this is an unrelated problem
        - Test also completed on Dell hardware with no issues

    PASS: Verify subcloud add as above using sushy emulator

    Signed-off-by: Kyle MacLeod <email address hidden>
    Change-Id: Ia2846b4d854a25a65a62ae2d4bae89ce72c251b3