Reviewed: https://review.opendev.org/716131 Committed: https://git.openstack.org/cgit/starlingx/root/commit/?id=e5faf8bd5cebfa275823de8cc10be1abbdc2f8f8 Submitter: Zuul Branch: f/centos8 commit b31cd4b01ee0e6c02cc35094b17aef0edd4f6071 Author: Don Penney Date: Wed Mar 25 15:19:07 2020 -0400 Update tag for stx-oidc-client to stx.4.0-v1.0.2 Change-Id: I6deab3e81b2210968c93f82d667003e5805a1136 Partial-Bug: 1868895 Signed-off-by: Don Penney commit bd0d9015fa095948443e29f40a701bc3f81c328f Author: Don Penney Date: Wed Mar 18 10:56:08 2020 -0400 Add managed tag for stx-platformclients image Change-Id: Id37f2eaf5bacaad941a7abaf835d3c7204d7ca97 Story: 2006711 Task: 39096 Signed-off-by: Don Penney commit f5985aa83ad6c5275f97db53db9a095a1f4a1bb1 Author: Davlet Panech Date: Wed Mar 18 16:29:40 2020 -0400 Use private yum cache dir in build scripts YUM & friends use a cache directory named /tmp/yum-$USER-xxx or similar, even when used concurrently e.g. when bulding unrelated source trees. This causes interference between CI pipelines. This patch sets TMPDIR=$MY_WORKSPACE/tmp when calling repoquery, etc. Change-Id: Ieeb4d6fd9447f1c2988380c3427975893be365a5 Closes-Bug: 1867817 Signed-off-by: Davlet Panech commit 7dc6b23b517d4d14cad38f29d47af64e66e105b9 Author: Stefan Dinescu Date: Wed Mar 18 16:23:59 2020 +0200 Support custom docker registries for remote cli The build script for remote cli was receiving as parameters only the desired tag for the clients docker images; the docker images were always pulled from docker.io/starlinx. Nowthe build script take the full link of the docker image as parameter, so we can use any docker registry as source for the client images. Change-Id: Ibc4584a9401c1ff30f8e657ca27d31b35c4e94d5 Depends-On: https://review.opendev.org/#/c/713665/ Story: 2006711 Task: 39095 Signed-off-by: Stefan Dinescu commit 3b0e2dd4ea92b4fe5b53b1fd4b38a5e673e9c92c Author: Davlet Panech Date: Mon Mar 9 14:54:10 2020 -0400 Fixed broken setuptools import pyScss tries to import a module called "Feature" from setuptools, which was removed from setuptools 46.0.0 (mar 8 2020). This causes compilation erros. The fix updates "pip install" in Dockerfile to install setuptools < 46.0.0 Change-Id: Ib5c00aafb934efaf1413e72ede30638f2dc35230 Signed-off-by: Davlet Panech Closes-Bug: 1866699 commit 3a95ab163f4cb4371fa4c6a94f5f64e27b1980f2 Author: Don Penney Date: Wed Mar 4 10:59:37 2020 -0500 Add tag for rvmc image Update tag management file to publish a static tag for the rvmc image. Change-Id: I459e4f676ffa0a28c2c1fca5d61df16f499ded93 Story: 2006980 Task: 38935 Signed-off-by: Don Penney commit 11ae91f2d85cd7cd9ab07d6595261b249df94855 Author: Don Penney Date: Sat Feb 22 08:33:35 2020 -0500 Update image tags for stx-oidc-client and n3000-opae Update image tags for the stx-oidc-client and n3000-opae images to point to new image versions. Change-Id: I15c8854c335911567c2ad5f38eedb95c0ba2ee91 Story: 2006711 Task: 38850 Signed-off-by: Don Penney commit 9b77e2e1b346c7f2f6fe617bc9c48e3c9c39d6de Author: Scott Little Date: Mon Oct 28 19:22:57 2019 -0400 Build avoidance fixes 1) Build avoidance fails on a clean workspace because directory $MY_WORKSPACE/tmp doesn't exist when mktemp needs to create a forth subdir under that path. Add a 'mkdir -p $MY_WORKSPACE/tmp' to ensure it exists prior to mktemp. 2) Failed to rebuild kmods after a kernel change and building with build-avoidance enabled. The problem was a missing dependency cache that would have listed the kmods as having dependencies on the kernel. Reusing kmods from a prior build in conjunction with a rebuilt kernel results int load with unusable kmods due to a key mismatch. Add the dependancy-cache to the list of artifacts to syncronize as part of build avoidance. A primed dependency cache will allow build-pkgs to determine that kmods must be rebuilt when the kernel has changed. 3) Make sure $MY_WORKSPACE/$BUILD_TYPE/repo symlink exists after a build avoidance build. If no packages require a rebuild, it was missing. 4) Fix an error message that was puzzling while debugging the above issues. Closes-Bug: 1864110 Change-Id: Ia912b2e3e110efbe69004d7978109ebb089d684b Signed-off-by: Scott Little commit b1532a41dacaa4b08fbf0d378adf51e17705c32c Author: Don Penney Date: Wed Feb 19 18:44:04 2020 -0500 Lock down upper-constraints for wheels Currently, the images built via loci are python2-based. Given that support for python2 has ended, most new module versions in pypi are python3-only. As a result, these new versions will fail to install in the image during the build. A recent change to the upstream upper-constraints upversioned the ovsdbapp module to a python3-only version, which caused the stx-nova and stx-neutron image builds to fail. As a temporary workaround until we can move these images to python3, this update locks down the upper-constraints and global-requirements files to a version prior to this change. Change-Id: Iaf0e9c76c96b21c398345dfc6b0b8715e978e879 Closes-Bug: 1863957 Signed-off-by: Don Penney commit 921cb526ffd9fe9d6dddcf7253bf0812d7299350 Author: Don Penney Date: Wed Feb 12 14:51:52 2020 -0500 Add tag-management utility This commit introduces a tag management utility for images to allow retagging of specific images. This allows the StarlingX ansible playbooks and packaged charts to use a static image tag rather than the moving stable-latest tag. This utility can only be run by a StarlingX build team member with publishing capability on the docker hub, to allow for updated tags to be available publicly, or as part of a CENGN build job. Change-Id: I7659695c701ccf3bfe8255b24ad0b1896b59cc23 Partial-Bug: 1854869 Signed-off-by: Don Penney commit d02fd0c39e6c9ee12afffd7fee2a8ebfbaf23e03 Author: Don Penney Date: Wed Feb 12 14:38:59 2020 -0500 Fix patch-iso for StarlingX repos The patch-iso utility is currently unable to find necessary files within the StarlingX repos. This commits corrects the location, allowing the utility to run. It also does a little cleanup to add robustness to the utility. Depends-On: https://review.opendev.org/707459 Change-Id: Ibacdfc7f06a464c7ef62e0a681f4f99e634057f2 Closes-Bug: 1863011 Signed-off-by: Don Penney commit d184c69b7c6c0f2cf93facf888182670211460ad Author: Don Penney Date: Wed Jan 15 14:22:45 2020 -0500 Update tox.ini bashate to test all bash scripts Currently, the tox.ini file is only running bashate against files that end in a .sh extension. However, many of the build tools do not have an extension, and therefore don't have bashate executed against them. This commit enhances the tox command to search for shell scripts regardless of file extension. The bashate ignore list has been updated to ignore all existing warnings. Future updates can perform cleanup to address the outstanding issues and remove items from the ignore list one by one. The original check of .sh is maintained with a smaller ignore list, to ensure new issues are not introduced. Change-Id: I07e8ac83c6ed3d81e7bfad19da1eee1747d60802 Signed-off-by: Don Penney commit b2286535c9270ca728a0ed5e053392e2961b9373 Author: Scott Little Date: Tue Dec 31 15:46:45 2019 -0500 Update to build tools to support Build layering. 1: Building rpms now produces an rpm.lst file. This file serves to list all rpms produced by the build. A seperate rpm.lst file is producede for each build type (std, rt, installer). The file is co-resident with the matching repodata directory. The rpm.lst files will need to be published by cengn for each layer build. The download tools in stx-tools will need to find the rpm.lst files of lower layer builds, and use it to direct the download of rpms from the lower layer. 2: Building rpms now produces an image.inc file. This file serves to list all rpms that the layer recommends be built into an iso. The file is stored under the $MY_WORKSPACE/ subdirectory, although it has identical content for any build-type. The image.inc file will need to be published by cengn for each layer build. The download tools in stx-tools will need to download the per-layer image.inc files to the $MY_REPO/cgcs-centos-repo/layer_image_inc/ sub-directory, renaming the file in some layer specific way. The build-iso tool will process any *.inc files found under $MY_REPO/cgcs-centos-repo/layer_image_inc/ , adding those rpms to the iso. 3) Add a mechanism for layer specific mock.cfg prototypes. This will allow special handling of the real-time (aka 'rt'), repositories for layer builds that need to do a 'rt' build. 4) Add support for a $MY_REPO/cgcs-centos-repo/rt subdirectory, a place to build a repo of real-time rpms originating from lower layer builds. The download tools in stx-tools will need to populate the new rt repos. As of this writing, non-rt rpms remain in $MY_REPO/cgcs-centos-repo/. i.e. there is not a new $MY_REPO/cgcs-centos-repo/std/ directory. 5) Some changes to make us more flexible about where we find realease and bsp files. 6) Found that kernel mudules were not reliably building against the hearnel-headers of our modified kernel. Found that adding '--update' to our mock build command was not working. Does mock expect '--update' to only be used independently of a build command? It does work when used in that manner, so that's what we will do. 7) The build-pkgs, build-srpms, build-rpms family of commands can take a layer argument and/or will read the LAYER environment variable. Current the only use of this variable is to modify the build-info. It does NOT limit the compile to packages for a specific layer. Story: 2006166 Task: 37094 Depends-On: https://review.opendev.org/698756 Depends-On: https://review.opendev.org/700819 Change-Id: I817e08a19cdabe08b3fcc47dee63a36b461c13c0 Co-Authored-by: Martin Chen