Request for unknown module key Magrathea

[Scott Little]

Brief Description
-----------------
kmods in designer built iso were unusable.

2019-10-25T01:34:13.600 localhost kernel: warning [ 9.643561] Request for unknown module key 'Magrathea: Glacier signing key: 39a45ad739cfddb9a1c5cd0c0743777d501339c9' err -11

Build avoidance was trying to reuse the build output from the previous Sunday's build.
However, the building of the kernel modules includes a step where it signs the module using the signing key generated by the kernel build, which it gets from the kernel-devel package:

Because the build is reusing kernel modules from a previous build, they're signed with the key from that build. Which doesn't match the new key in the new build.

Kmods should be rebuilt in this case.

Reason for failure to rebuild kmods was tracked down to missing dependency data.

Severity
--------
Major

Steps to Reproduce
------------------
Clone source, make a kernel change, attempt build-pkgs --build-avoidance.
Workspace must have been empty. No dependency data from a prior build.

Expected Behavior
------------------
kernel and kmods build. ISO can boot and load kmods.

Actual Behavior
----------------
kmods are not rebuilt. A iso was created, but was unusable because kmods could not be loaded.
Error message is strange... "Request for unknown module key Magrathea"

Reproducibility
---------------
<Reproducible/Intermittent/Seen once>
Reproducible

System Configuration
--------------------
N/A

Branch/Pull Time/Commit
-----------------------
2019-10-25

Last Pass
---------
N/A

Timestamp/Logs
--------------
2019-10-25T01:34:13.600 localhost kernel: warning [ 9.643561] Request for unknown module key 'Magrathea: Glacier signing key: 39a45ad739cfddb9a1c5cd0c0743777d501339c9' err -11
2019-10-25T01:34:13.600 localhost kernel: warning [ 9.658704] e1000e: loading out-of-tree module taints kernel.
2019-10-25T01:34:13.600 localhost kernel: notice [ 9.682231] e1000e: module verification failed: signature and/or required key missing - tainting kernel
2019-10-25T01:34:13.600 localhost kernel: info [ 9.697621] e1000e: Intel(R) PRO/1000 Network Driver - 3.4.2.1-NAPI
2019-10-25T01:34:13.600 localhost kernel: info [ 9.706052] e1000e: Copyright(c) 1999 - 2018 Intel Corporation.
2019-10-25T01:34:13.600 localhost kernel: warning [ 9.714753] Request for unknown module key 'Magrathea: Glacier signing key: 39a45ad739cfddb9a1c5cd0c0743777d501339c9' err -11
2019-10-25T01:34:13.600 localhost kernel: info [ 9.731698] i40e: Intel(R) 40-10 Gigabit Ethernet Connection Network Driver - version 2.7.29
2019-10-25T01:34:13.600 localhost kernel: info [ 9.731698] i40e: Copyright(c) 2013 - 2018 Intel Corporation.
2019-10-25T01:34:13.600 localhost kernel: warning [ 9.732256] Request for unknown module key 'Magrathea: Glacier signing key: 39a45ad739cfddb9a1c5cd0c0743777d501339c9' err -11

Test Activity
-------------
Build

 Workaround
 ----------
Do not use build-avoidance option for build-pkgs

[Ghada Khalil (gkhalil)]

stx.4.0 / major priority - built iso is unusable

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/708746
Committed: https://git.openstack.org/cgit/starlingx/root/commit/?id=9b77e2e1b346c7f2f6fe617bc9c48e3c9c39d6de
Submitter: Zuul
Branch: master

commit 9b77e2e1b346c7f2f6fe617bc9c48e3c9c39d6de
Author: Scott Little <email address hidden>
Date: Mon Oct 28 19:22:57 2019 -0400

    Build avoidance fixes

    1) Build avoidance fails on a clean workspace because directory
    $MY_WORKSPACE/tmp doesn't exist when mktemp needs to
    create a forth subdir under that path.

    Add a 'mkdir -p $MY_WORKSPACE/tmp' to ensure it exists
    prior to mktemp.

    2) Failed to rebuild kmods after a kernel change and
    building with build-avoidance enabled. The problem was
    a missing dependency cache that would have listed
    the kmods as having dependencies on the kernel.
    Reusing kmods from a prior build in conjunction with
    a rebuilt kernel results int load with unusable kmods
    due to a key mismatch.

    Add the dependancy-cache to the list of artifacts to
    syncronize as part of build avoidance. A primed
    dependency cache will allow build-pkgs to determine
    that kmods must be rebuilt when the kernel has changed.

    3) Make sure $MY_WORKSPACE/$BUILD_TYPE/repo
    symlink exists after a build avoidance build.
    If no packages require a rebuild, it was missing.

    4) Fix an error message that was puzzling while debugging
    the above issues.

    Closes-Bug: 1864110
    Change-Id: Ia912b2e3e110efbe69004d7978109ebb089d684b
    Signed-off-by: Scott Little <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: f/centos8
Review: https://review.opendev.org/716131

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/716131
Committed: https://git.openstack.org/cgit/starlingx/root/commit/?id=e5faf8bd5cebfa275823de8cc10be1abbdc2f8f8
Submitter: Zuul
Branch: f/centos8

commit b31cd4b01ee0e6c02cc35094b17aef0edd4f6071
Author: Don Penney <email address hidden>
Date: Wed Mar 25 15:19:07 2020 -0400

    Update tag for stx-oidc-client to stx.4.0-v1.0.2

    Change-Id: I6deab3e81b2210968c93f82d667003e5805a1136
    Partial-Bug: 1868895
    Signed-off-by: Don Penney <email address hidden>

commit bd0d9015fa095948443e29f40a701bc3f81c328f
Author: Don Penney <email address hidden>
Date: Wed Mar 18 10:56:08 2020 -0400

    Add managed tag for stx-platformclients image

    Change-Id: Id37f2eaf5bacaad941a7abaf835d3c7204d7ca97
    Story: 2006711
    Task: 39096
    Signed-off-by: Don Penney <email address hidden>

commit f5985aa83ad6c5275f97db53db9a095a1f4a1bb1
Author: Davlet Panech <email address hidden>
Date: Wed Mar 18 16:29:40 2020 -0400

    Use private yum cache dir in build scripts

    YUM & friends use a cache directory named /tmp/yum-$USER-xxx or
    similar, even when used concurrently e.g. when bulding unrelated
    source trees. This causes interference between CI pipelines.

    This patch sets TMPDIR=$MY_WORKSPACE/tmp when calling repoquery,
    etc.

    Change-Id: Ieeb4d6fd9447f1c2988380c3427975893be365a5
    Closes-Bug: 1867817
    Signed-off-by: Davlet Panech <email address hidden>

commit 7dc6b23b517d4d14cad38f29d47af64e66e105b9
Author: Stefan Dinescu <email address hidden>
Date: Wed Mar 18 16:23:59 2020 +0200

    Support custom docker registries for remote cli

    The build script for remote cli was receiving as parameters
    only the desired tag for the clients docker images; the docker
    images were always pulled from docker.io/starlinx.

    Nowthe build script take the full link of the docker image
    as parameter, so we can use any docker registry as source
    for the client images.

    Change-Id: Ibc4584a9401c1ff30f8e657ca27d31b35c4e94d5
    Depends-On: https://review.opendev.org/#/c/713665/
    Story: 2006711
    Task: 39095
    Signed-off-by: Stefan Dinescu <email address hidden>

commit 3b0e2dd4ea92b4fe5b53b1fd4b38a5e673e9c92c
Author: Davlet Panech <email address hidden>
Date: Mon Mar 9 14:54:10 2020 -0400

    Fixed broken setuptools import

    pyScss tries to import a module called "Feature" from setuptools,
    which was removed from setuptools 46.0.0 (mar 8 2020). This causes
    compilation erros. The fix updates "pip install" in Dockerfile
    to install setuptools < 46.0.0

    Change-Id: Ib5c00aafb934efaf1413e72ede30638f2dc35230
    Signed-off-by: Davlet Panech <email address hidden>
    Closes-Bug: 1866699

commit 3a95ab163f4cb4371fa4c6a94f5f64e27b1980f2
Author: Don Penney <email address hidden>
Date: Wed Mar 4 10:59:37 2020 -0500

    Add tag for rvmc image

    Update tag management file to publish a static tag for the rvmc image.

    Change-Id: I459e4f676ffa0a28c2c1fca5d61df16f499ded93
    Story: 2006980
    Task: 38935
    Signed-off-by: Don Penney <don.penney...