build: kernel 6.6: docker image "stx-neutron" fails to compile

[Davlet Panech]

Brief Description
-----------------
Docker image stx-neutron fails to compile in f/kernel-6.6 branch. It's part of a separate Jenkins build that compiles only openstack images.

I believe the reason is we are missing this cherry pick:

https://review.opendev.org/c/starlingx/root/+/909111

which affects the "build-wheels" step.

Severity
--------
Major

Steps to Reproduce
------------------
Set up the environment using the "stx-openstack.xml" manifest; build all packages, docker base image, wheels, then stx-neutron. The process below is approximate, I didn't actually try this:

#### outside "stx shell":
<...>
repo init -u https://opendev.org/starlingx/manifest -b f/kernel-6.6 -m stx-openstack.xml
repo sync
<...>

#### inside "stx shell":

downloader
build-pkgs

# configure git if you haven't already
#git config --global user.email "<email address hidden>"
#git config --global user.name "Your Name"

# base image
( cd $MY_REPO/build-tools/build-docker-images && ./build-stx-base.sh --version DEV --local --cache ; )

# wheels
( cd $MY_REPO/build-tools/build-wheels && ./build-wheel-tarball.sh --cache ; )

# stx-neutron
( cd $MY_REPO/build-tools/build-docker-images && ./build-stx-images.sh --version=DEV --base=$USER/stx-debian:DEV --no-pull-base --wheels=$MY_WORKSPACE/std/build-wheels-debian-stable/stx-debian-stable-wheels.tar --cache --only=stx-neutron ; )

Expected Behavior
------------------
Build succeeds

Actual Behavior
----------------
Build fails with python errors complaining about neutron/neutron-lib conflicts

Reproducibility
---------------
Reproducible

System Configuration
--------------------
N/A

Branch/Pull Time/Commit
-----------------------
master/20240529

Last Pass
---------
N/A

Timestamp/Logs
--------------

From: https://mirror.starlingx.windriver.com/mirror/starlingx/feature/kernel-6.6/debian/openstack/20240527T030000Z/logs/build-docker-images-stable.log.txt

[2024-05-27T09:53:25.713Z] Building stx-neutron
[2024-05-27T09:53:25.713Z] Python3 service stx-neutron
<...>
[2024-05-27T09:56:01.248Z] + pip install --no-cache-dir --only-binary :all: --no-compile -c /tmp/wheels/upper-constraints.txt --find-links /tmp/wheels/ /tmp/neutron lxml networking-sfc pycrypto tinyrpc
<...>
[2024-05-27T09:56:07.641Z] Processing /tmp/wheels/netifaces-0.10.9-cp39-cp39-linux_x86_64.whl
[2024-05-27T09:56:07.641Z] ERROR: Cannot install neutron==22.1.1.dev121 because these package versions have conflicting dependencies.
[2024-05-27T09:56:07.641Z] ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies
[2024-05-27T09:56:07.641Z]
[2024-05-27T09:56:07.641Z] The conflict is caused by:
[2024-05-27T09:56:07.641Z] neutron 22.1.1.dev121 depends on neutron-lib>=3.4.2
[2024-05-27T09:56:07.641Z] The user requested (constraint) neutron-lib===3.4.0
[2024-05-27T09:56:07.641Z]
[2024-05-27T09:56:07.641Z] To fix this you could try to:
[2024-05-27T09:56:07.641Z] 1. loosen the range of package versions you've specified
[2024-05-27T09:56:07.641Z] 2. remove package versions to allow pip attempt to solve the dependency conflict
[2024-05-27T09:56:07.641Z]
[2024-05-27T09:56:07.891Z] WARNING: You are using pip version 21.2.3; however, version 24.0 is available.
[2024-05-27T09:56:07.891Z] You should consider upgrading via the '/var/lib/openstack/bin/python -m pip install --upgrade pip' command.
[2024-05-27T09:56:08.803Z] The command '/bin/sh -c /opt/loci/stx-scripts/install.sh' returned a non-zero code: 1
[2024-05-27T09:56:08.803Z] Command (docker) failed, attempt 1 of 3.
[2024-05-27T09:56:08.803Z] Waiting 30 seconds before retrying...

Test Activity
-------------
N/A

Workaround
----------
N/A

[Davlet Panech (dpanech)]

@Linda Wang - please assign someone on your team.

For additional help with building, please contact @Thales Elero Cervi

[Thales Elero Cervi (tcervi)]

@Linda Wang
please do not hesitate in contacting me or @Lucas de Ataides if case your team needs help with testing the fix.

[Linda Wang (lwang8)]

Assign to Madan Kanala to help take a look at this issue.

[Madan Kanala (mkanala)]

I have started looking into this issue.

[Madan Kanala (mkanala)]

2024-06-13 14:29:50,948 - downloader - ERROR: +++++++++++++++++++++++++++++++++++++++++++++++++
2024-06-13 14:29:50,948 - downloader - ERROR: Failed to download packages: 2
2024-06-13 14:29:50,948 - downloader - ERROR: linux
2024-06-13 14:29:50,948 - downloader - ERROR: linux-rt
2024-06-13 14:29:50,948 - downloader - INFO: Verifying downloader return status
2024-06-13 14:29:50,948 - downloader - INFO: All binaries were downloaded
2024-06-13 14:29:50,948 - downloader - ERROR: Source downloader failed
2024-06-13 14:29:50,948 - downloader - ERROR: Packages failed to download:
2024-06-13 14:29:50,948 - downloader - ERROR: linux
2024-06-13 14:29:50,948 - downloader - ERROR: linux-rt
2024-06-13 14:29:50,948 - downloader - INFO: Downloader done

Getting this problem when downloader command is run

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: f/kernel-6.6
Review: https://review.opendev.org/c/starlingx/root/+/922070

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Madan Kanala <email address hidden>" on branch: f/kernel-6.6
Review: https://review.opendev.org/c/starlingx/root/+/922070
Reason: https://review.opendev.org/c/starlingx/root/+/922071

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/root/+/922071
Committed: https://opendev.org/starlingx/root/commit/753879688ce23b15cf59db8271f6fb58a70c85e1
Submitter: "Zuul (22348)"
Branch: f/kernel-6.6

commit 753879688ce23b15cf59db8271f6fb58a70c85e1
Author: Lucas de Ataides <email address hidden>
Date: Thu Feb 15 09:44:12 2024 -0300

    Build neutron-lib wheels from 3.4.0 to 3.4.2

    The master branch build of the stx-neutron container is failing on a
    dependency python issue. The neutron 22.1.1.dev85 version modified the
    minimum required version for the neutron-lib package, and that is
    causing the build of the stx-neutron image to fail.

    This change updates the wheels of the neutron-lib package to version
    3.4.2, in order to fix the build for this image.

    Test plan:
    PASS: Build wheels
    PASS: Build stx-neutron image
    PASS: Build all images

    Closes-Bug: 2067500

    Change-Id: I9ef49300898b6697852e9f3aa6163b6b684d2803
    Signed-off-by: Lucas de Ataides <email address hidden>
    (cherry picked from commit 15e4a4b3f8cbf1f4b3eff07961c97545c4e57eb7)
    Signed-off-by: Madan Kanala <email address hidden>

[Ghada Khalil (gkhalil)]

Setting to Fix Released as a fix has been merged. The builds are typically scheduled for Sundays, but Davlet will start one on Wed June 19 to confirm that this is indeed fixed.