"neutron-ovs-grenade-multinode" and "neutron-ovn-grenade-multinode" failing in 2023.1 and Zed

[Rodolfo Alonso]

The issue seems to be in the neutron-lib version installed:
2024-02-07 16:19:35.155231 | compute1 | ERROR: neutron 21.2.1.dev38 has requirement neutron-lib>=3.1.0, but you'll have neutron-lib 2.20.2 which is incompatible.

That leads to an error when starting the Neutron API (an API definition is not found) [1]:
Feb 07 16:13:54.385467 np0036680724 neutron-server[67288]: ERROR neutron ImportError: cannot import name 'port_mac_address_override' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py)

Setting priority to Critical because that affects to the CI.

[1]https://9faad8159db8d6994977-b587eccfce0a645f527dfcbc49e54bb4.ssl.cf2.rackcdn.com/891397/4/check/neutron-ovs-grenade-multinode/ba47cef/controller/logs/screen-q-svc.txt

[Bence Romsics (bence-romsics)]

At a first glance I only found broken jobs on stable/zed. Where grenade is upgrading from yoga. Could the stable/yoga -> unmaintained/yoga branch rename affect this?

[Lajos Katona (lajos-katona)]

I suppose for 2023.1 these and similar lines seems guilty:
https://opendev.org/openstack/neutron/src/branch/stable/2023.1/zuul.d/grenade.yaml#L377

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/neutron/+/908790

[Lajos Katona (lajos-katona)]

another suspicious hing is the regexes which we have for example for grnenade:
https://opendev.org/openstack/grenade/src/branch/stable/zed/.zuul.yaml#L399

[Lajos Katona (lajos-katona)]

Grenade patch which can be related: https://review.opendev.org/c/openstack/grenade/+/908795

[Lajos Katona (lajos-katona)]

Another one which I beleive necessary: https://review.opendev.org/c/openstack/grenade/+/908826

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron/+/908790
Committed: https://opendev.org/openstack/neutron/commit/331f6ae2400a1120b63f966c0e463dd4598bd2c9
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit 331f6ae2400a1120b63f966c0e463dd4598bd2c9
Author: elajkat <email address hidden>
Date: Mon Feb 12 15:06:33 2024 +0100

    Unmaintained-Only: change stable/yoga to unmaintained

    Grenade skip level jobs reference stable/yoga but that branch
    was renamed to unmaintained/yoga

    Change-Id: Ifdfa194a95a39c63ec61f2afe030fed108de5a77
    Related-Bug: #2052915

[Mohammed Naser (mnaser)]

Nova is also affected by this.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/neutron/+/910379

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/neutron/+/910379
Committed: https://opendev.org/openstack/neutron/commit/b7e219391d85f9c7651868f498b00627dacef354
Submitter: "Zuul (22348)"
Branch: stable/zed

commit b7e219391d85f9c7651868f498b00627dacef354
Author: elajkat <email address hidden>
Date: Tue Feb 27 18:51:40 2024 +0100

    Stable-Only: Temporary stop running grenade jobs on Zed

    Due to the change of stable/yoga to unmaintained/yoga grenade jobs
    are failing on stable/zed.
    We temporary disabling these jobs, also removes the skip level job from
    periodic queue, but keeps as it is in experimental queue.

    Once the issue is fixed we can re enable these jobs.

    Change-Id: I18b825c8ba7cfb38d82fd259b74a02877eb839d1
    Related-Bug: #2052915

[Sylvain Bauza (sylvain-bauza)]

I think this is fixed on Nova, right?

[Sylvain Bauza (sylvain-bauza)]

As discussed on the nova meeting, nova-grenade-multinode is no longer failing, so I'll close this bug report only for Nova.