ironic uefi grub PXE booting ubuntu ironic-python-agent images fails

[xinliang]

Overview:
kolla-ansible deployment with debian source train image, ironic pxe booting ubuntu ironic-python-agent images fails

Steps to Reproduce: Minimized, easy-to-follow steps that will trigger the bug. Include any special setup steps.
1. kolla-ansible deployment with debian source train image
2. build ubuntu ironic-python-agent images and upload to glance
$ ironic-python-agent-builder ubuntu-minimal
3. Booting bare metal instance
$ openstack server create --image cirros --flavor D05 --key-name mykey --network public1 demo1

Actual Results: pxe booting fails

Expected Results: pxe deploy booting success

Additional Information:

pxe booting failure log:
error: invalid magic number.
error: you need to load the kernel first.

Press any key to continue...

[xinliang (xin3liang)]

Using debian provided signed grub it can boot ubuntu deploy images:

(ironic-pxe)[root@j12-d05-07 tftpboot]# apt-get install grub-efi-arm64-signed shim-signed
(ironic-pxe)[root@j12-d05-07 tftpboot]# cp /usr/lib/shim/shimaa64.efi.signed /tftpboot/bootaa64.efi
(ironic-pxe)[root@j12-d05-07 tftpboot]# cp /usr/lib/grub/arm64-efi-signed/grubnetaa64.efi.signed /tftpboot/grubaa64.efi

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/kolla/+/826610

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla/+/826611

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/victoria
Review: https://review.opendev.org/c/openstack/kolla/+/826612

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla/+/826610
Committed: https://opendev.org/openstack/kolla/commit/2171f0a7babe1e25381a430a079198e079202b67
Submitter: "Zuul (22348)"
Branch: stable/xena

commit 2171f0a7babe1e25381a430a079198e079202b67
Author: Xinliang Liu <email address hidden>
Date: Fri May 15 07:12:56 2020 +0000

    Use distro provided GRUB efi

    Use distro provided GRUB efi instead of creating it like ironic GRUB
    setup doc[1]. This avoids below ubuntu ironic-python-agent images PXE
    booting failure.
    ----------
    error: invalid magic number.
    error: you need to load the kernel first.

    Press any key to continue...
    ----------

    This also fixes x86_64 uefi pxe booting issue by setting up GRUB efi
    for x86_64.

    Besides, GRUB setup only needs to do once at bootstrap stage.

    [1]:
    https://docs.openstack.org/ironic/train/install/configure-pxe.html#uefi-pxe-GRUB-setup

    Closes-Bug: #1879265
    Change-Id: I8be5bdf5f1a62751aefe6bd0959e8f558fcfe591
    (cherry picked from commit b6e057d694d90d50ea278411d0edf20afe427e13)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla/+/826611
Committed: https://opendev.org/openstack/kolla/commit/67e4f50bf7cd7166b27dcd38611215327b722cb8
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 67e4f50bf7cd7166b27dcd38611215327b722cb8
Author: Xinliang Liu <email address hidden>
Date: Fri May 15 07:12:56 2020 +0000

    Use distro provided GRUB efi

    Use distro provided GRUB efi instead of creating it like ironic GRUB
    setup doc[1]. This avoids below ubuntu ironic-python-agent images PXE
    booting failure.
    ----------
    error: invalid magic number.
    error: you need to load the kernel first.

    Press any key to continue...
    ----------

    This also fixes x86_64 uefi pxe booting issue by setting up GRUB efi
    for x86_64.

    Besides, GRUB setup only needs to do once at bootstrap stage.

    [1]:
    https://docs.openstack.org/ironic/train/install/configure-pxe.html#uefi-pxe-GRUB-setup

    Closes-Bug: #1879265
    Change-Id: I8be5bdf5f1a62751aefe6bd0959e8f558fcfe591
    (cherry picked from commit b6e057d694d90d50ea278411d0edf20afe427e13)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla/+/826612
Committed: https://opendev.org/openstack/kolla/commit/02f5222b0c8fdbdc9bb5343f678ecd137c8e5433
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit 02f5222b0c8fdbdc9bb5343f678ecd137c8e5433
Author: Xinliang Liu <email address hidden>
Date: Fri May 15 07:12:56 2020 +0000

    Use distro provided GRUB efi

    Use distro provided GRUB efi instead of creating it like ironic GRUB
    setup doc[1]. This avoids below ubuntu ironic-python-agent images PXE
    booting failure.
    ----------
    error: invalid magic number.
    error: you need to load the kernel first.

    Press any key to continue...
    ----------

    This also fixes x86_64 uefi pxe booting issue by setting up GRUB efi
    for x86_64.

    Besides, GRUB setup only needs to do once at bootstrap stage.

    [1]:
    https://docs.openstack.org/ironic/train/install/configure-pxe.html#uefi-pxe-GRUB-setup

    Closes-Bug: #1879265
    Change-Id: I8be5bdf5f1a62751aefe6bd0959e8f558fcfe591
    (cherry picked from commit b6e057d694d90d50ea278411d0edf20afe427e13)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 14.0.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 11.3.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 12.2.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 13.1.0 release.