Merge dpdk from Debian unstable for lunar

[Bryce Harrington]

Scheduled-For: ubuntu-23.01
Upstream: tbd
Debian: 21.11-5 21.11-4~exp1
Ubuntu: 21.11.2-0ubuntu1

Debian new has 21.11-4~exp1

### New Debian Changes ###

dpdk (21.11-5) unstable; urgency=medium

  * librte-meta-common: remove armhf build

 -- Luca Boccassi <email address hidden> Fri, 26 Aug 2022 10:58:41 +0100

dpdk (21.11-4) unstable; urgency=medium

  * Upload to unstable.

 -- Luca Boccassi <email address hidden> Thu, 25 Aug 2022 10:57:13 +0100

dpdk (21.11-4~exp1) experimental; urgency=medium

  * Revert 'Revert 'd/control, d/rules: add librte-meta-common package''

 -- Luca Boccassi <email address hidden> Fri, 19 Aug 2022 22:07:18 +0100

dpdk (21.11-3) unstable; urgency=medium

  * Revert 'd/control, d/rules: add librte-meta-common package'
    It will reinstated later, but need to do the 21.11 transition
    without hitting the NEW queue for now.

 -- Luca Boccassi <email address hidden> Fri, 19 Aug 2022 22:05:15 +0100

dpdk (21.11-2) unstable; urgency=medium

  * Merge remote-tracking branch 'experimental' into unstable
  * Update Lintian overrides syntax
  * Bump Standards-Version to 4.6.1, no changes
  * Bump copyright year ranges in d/copyright
  * Upload to unstable

 -- Luca Boccassi <email address hidden> Fri, 19 Aug 2022 15:54:21 +0100

dpdk (21.11-1) experimental; urgency=medium

  [ Christian Ehrhardt ]
  * Update upstream source from tag 'upstream/21.11_rc1'
  * Update upstream source from tag 'upstream/21.11_rc2'
  * d/p/disable_ppc64_autopkgtest_fails.patch: update for 21.11
  * d/p/disable_ppc64_autopkgtest_fails.patch: add rib and rib6 to known
    flaky tests on ppc64
  * d/dpdk-dev.install: removed non-existing autotest wrappers
  * d/control: bump ABI to 22
  * d/*.symbols: bump for ABI 22
  * d/*.symbols: register DPDK_22 in libs that were already stable before
  * d/*.symbols: rename to match the ABI change
  * d/*.symbols: files for new libs and pmds
  * d/update-helper-control.py: adapt for single digit ABI version
  * d/update-helper-control.py: fix escaping for re
  * d/rules: drop per_library_versions removed since 19.11 (Closes:
    #998532)
  * d/dpdk-dev.install: new binary dpdk-dumpcap
  * d/control: new libs and pmds in 21.11 (baseband-la12xx22, crypto-
    ipsec-mb22, dma-idxd22, dma-ioat22, dma-skeleton22, dmadev22, net-
    pcapng22)
  * d/control, d:rules: add meta package for new dmadevs
  * d/control: pcapng does not have the usual -net prefix
  * d/*.symbols: drop no more existing .21 ABI references
  * d/control: remove librte-raw-ioat22
  * d/control: remove raw/octeontx2_ep and raw/octeontx2_dma
  * Drop crypto libs now part of ipsec_mb framework
  * d/control: disable pkgs not built on ppc64 (crypto-ipsec-mb, dma-idxd,
    dma-ioat, net-hns3, event/dlb2)
  * d/control: disable pkgs not built on arm (event-dlb2, dma-idxd, dma-
    ioat, crypto-ipsec-mb2)
  * d/control: drop armhf builds
  * d/rules: -Dmachine is deprecated use -Dplatform instead
  * d/p/disable_autopkgtest_buildtime_fails.patch: avoid FTBFS by build
    env test incompatibility
  * d/rules: track build architecture
  * d/rules: check for expected target CPUs
  * d/rules: compat for rte_machine
  * d/p/disable_*: update test patches to 21.11-rc2
  * d/rules: fixup the CPU type check
  * d/control: fix doc link of librte-vdpa-ifc22
  * d/dpdk-dev.install: add dpdk-test-gpudev
  * d/control: new libs in 22.11-rc2 (dma_hisilicon, vdpa_sfc, dma_cnxk,
    gpudev)
  * d/*.symbols: new libs in 22.11-rc2 (dma_hisilicon, vdpa_sfc, dma_cnxk,
    gpudev)
  * d/*.symbols: new symbols with 21.11-rc2
  * d/p/test-fastsuite: skip if failing at build stage
  * d/rules: ease debugging of meson build info
  * d/rules: remove sphinx object.inv (breaks reproducible builds)
  * d/rules: meson build dir needs DEB_HOST_GNU_TYPE

  [ Luca Boccassi ]
  * d/*.symbols: add/remove new/old symbols
  * lintian: ignore very-long-line-length-in-source-file
  * d/copyright: bump year range for debian/* stanza
  * lintian: drop unused override
  * Bump Standards-Version to 4.6.0, no changes
  * librte-baseband-la12xx22: fix short description
  * d/rules: generate lintian override for ldconfig-escape for PMDs
  * libdpdk-dev: ignore ldconfig-escape lintian warning
  * Add symbols file for librte-pcapng22
  * d/rules: fix path to remove objects.inv

### Old Ubuntu Delta ###

dpdk (21.11.2-0ubuntu1) kinetic; urgency=medium

  * Merge LTS stable release 21.11.2 (LP: #1975764)
    - Among many general fixed this adresses two CVEs:
      + vhost: DoS triggered by sending a crafted Vhost header (CVE-2022-2132)
      + net/mlx5: bad error recovery can lead to DoS (CVE-2022-28199)
    - Full release notes are available at:
      https://doc.dpdk.org/guides-21.11/rel_notes/release_21_11.html#id1

 -- Christian Ehrhardt <email address hidden> Thu, 08 Sep 2022 10:18:45 +0200

dpdk (21.11.1-0ubuntu0.3) jammy-security; urgency=medium

  * Merge LTS stable release 21.11.1
    Release notes are available at:
    - https://doc.dpdk.org/guides-21.11/rel_notes/release_21_11.html#fixes
    - Among many general fixed this adresses two CVEs:
      + out of bounds write due to invalid queue number (CVE-2021-3839)
      + denial of service by injecting inflight messages (CVE-2022-0669)
    - d/*.symbols: adapt symbols for the 21.11.1 release
      This was discussed with upstream in [1] and all are considered save
      and are intentional.

 -- Christian Ehrhardt <email address hidden> Tue, 26 Apr 2022 14:49:12 +0200

dpdk (21.11-1build1) jammy; urgency=medium

  * No-change rebuild to update maintainer scripts, see LP: 1959054

 -- Dave Jones <email address hidden> Wed, 16 Feb 2022 16:52:36 +0000

[Christian Ehrhardt  (paelzer)]

As coordinated with fnordahl and bluca - we got all ready in Debian.
And will now:
CE 1. sync DPDK 22.11
CE 2a. no change rebuild uhd
CE 2b. no change rebuild collectd
FN 3. sync openvswitch
FN 4. sync ovn

[Christian Ehrhardt  (paelzer)]

Started build at
https://launchpad.net/ubuntu/+source/dpdk/22.11.1-2

It worked a while ago in a PPA, let us hope no unexpected build or test issues happen.

[Frode Nordahl (fnordahl)]

Thank you for the cooperation on this, I have created bug 2001683 to track the progress of the openvswitch sync and bug 2001685 to track the progress of the ovn sync.

[Christian Ehrhardt  (paelzer)]

This bug was fixed in the package dpdk - 22.11.1-2

---------------
dpdk (22.11.1-2) unstable; urgency=medium

  * d/watch: restrict to 22.11 LTS
  * Upload to unstable

 -- Luca Boccassi <email address hidden> Sat, 17 Dec 2022 13:59:11 +0000

dpdk (22.11.1-1) experimental; urgency=medium

  * Update upstream source from tag 'upstream/22.11.1'
  * Drop Revert-drivers-omit-symbol-map-when-unneeded.patch, fixed
    upstream
  * Adjust symbols versions for PMDs for 22.11.1

 -- Luca Boccassi <email address hidden> Wed, 14 Dec 2022 09:50:03 +0000

dpdk (22.11-1) experimental; urgency=medium

  * Update upstream source from tag 'upstream/22.11'
  * Drop docs-sort-files-lists-in-generator-scripts.patch, merged upstream
  * Install new dpdk-test-security-perf in dpdk-dev
  * Remove ~rc2-1 from d/*.symbols
  * Revert change to make all PMD functions public APIs
  * Drop obsolete NEWS file

 -- Luca Boccassi <email address hidden> Mon, 28 Nov 2022 14:55:02 +0000

dpdk (22.11~rc2-1) experimental; urgency=medium

  [ Christian Ehrhardt ]
  * Update upstream source from tag 'upstream/22.11_rc2'
    this includes various fixes like (closes: #1023000):
    - vhost: fix header spanned across more than two descriptors
      (CVE-2022-2132)
    - vhost: discard too small descriptor chains
      (CVE-2022-2132)
    - net/mlx5: fix Rx queue recovery mechanism
      (CVE-2022-28199)
  * d/control: Bump to 22.11 ABI 23
  * d/p/disable_*_autopkgtest_fails.patch: update to match dpdk 22.11
  * d/control: new libs in 22.11-rc2
    - libs renamed baseband-acc100 -> baseband-acc
    - new libs: common-idpf, dma-dpaa2, net-gve, net-idpf, net-octeon-ep,
      raw-cnxk-gpio, regex-cn9k
    - removed libs: octeontx2-*, flow-classify, kni, librte-net-octeontx-ep23,
      raw-dpaa2-qdma23
  * d/*.symbols: update for 22.11
    - bump for ABI 23
    - register DPDK_23 in libs that were already stable before
    - rename to match the ABI change
    - add new libs in 22.11-rc2
    - remove older non symbol specific Missing statements
    - drop/update old ABI 22 references
    - d/*.symbols: drop removed libs
    - d/*.symbols: update changing symbols
  * avoid flaky test fails (closes: #1021231)
    - d/t/test-fastsuite: bump timeout 3->12
    - d/rules: bump timeout 3->6 (build had less issues and
      does more other things that consume time)
  * d/t/control: add jq to enable further tests
  * d/control: add libxdp-dev to libdpdk-dev as well to avoid pkconfig errors

  [ Luca Boccassi ]
  * Add build-dep on libxdp-dev (closes: #1023569)
  * Backport patch to fix documentation reproducibility
  * Bump debhelper-compat to 13

 -- Luca Boccassi <email address hidden> Mon, 14 Nov 2022 15:31:51 +0000

[Christian Ehrhardt  (paelzer)]

It built and passed the new queue, but testing and updating dependencies will take some time before we call this fully complete.

[Christian Ehrhardt  (paelzer)]

- dpdk built https://launchpad.net/ubuntu/+source/dpdk/22.11.1-2
- uhd built against it https://launchpad.net/ubuntu/+source/uhd/4.3.0.0+ds1-4build2
- collectd needed y py3.11 fix but then also built against it https://launchpad.net/ubuntu/+source/collectd/5.12.0-11ubuntu1

Checking test results in a day or two once through the queue.

[Christian Ehrhardt  (paelzer)]

Component mismatches, some expected and to be moved to universe binaries, but others should not exists.
We will need to have a look:
- dpdk -> libipsec-mb1
- dpdk -> libisal2
- dpdk -> libxdp1

[Christian Ehrhardt  (paelzer)]

Also arm tests build the full source and that exceeds the timeout nowadays :-/

[Christian Ehrhardt  (paelzer)]

Checking the binaries that depend on universe pkgs:
- librte-net-af-xdp23 -> libxdp1
- librte-compress-isal23 -> libisal2
- librte-compress-octeontx23 -> libisal2
- librte-crypto-ipsec-mb23 -> libipsec-mb1
- librte-common-qat23 -> libipsec-mb1

But (as expected) those are all rather uncommon universe binaries of the many that DPDK builds.

old
 librte-compress-octeontx22 | 21.11.2-0ubuntu1 | lunar/universe | amd64, arm64, ppc64el
 librte-crypto-ipsec-mb22 | 21.11.2-0ubuntu1 | lunar/universe | amd64
 librte-net-af-xdp22 | 21.11.2-0ubuntu1 | lunar/universe | amd64, arm64, ppc64el
 librte-common-qat22 | 21.11.2-0ubuntu1 | lunar/universe | amd64, arm64, ppc64el

new
 librte-compress-isal23 | 22.11.1-2 | lunar-proposed | amd64, riscv64
 librte-compress-octeontx23 | 22.11.1-2 | lunar-proposed | amd64, arm64, ppc64el, riscv64
 librte-common-qat23 | 22.11.1-2 | lunar-proposed | amd64, arm64, ppc64el, riscv64
 librte-net-af-xdp23 | 22.11.1-2 | lunar-proposed | amd64, arm64, ppc64el, riscv64
 librte-crypto-ipsec-mb23 | 22.11.1-2 | lunar-proposed | amd64, riscv64

That is due to the versioned names meaning they all passed NEW, and when doing so all new binaries inherit main/universe from the source. So all of them got mapped to main which is wrong.
As expected I found quite a bunch in https://people.canonical.com/~ubuntu-archive/component-mismatches-proposed.html and resolved them.

Override component to universe
librte-acl23 22.11.1-2 in lunar amd64: main/libs/optional/100% -> universe
librte-acl23 22.11.1-2 in lunar arm64: main/libs/optional/100% -> universe
librte-acl23 22.11.1-2 in lunar ppc64el: main/libs/optional/100% -> universe
librte-acl23 22.11.1-2 in lunar riscv64: main/libs/optional/100% -> universe
librte-baseband-acc23 22.11.1-2 in lunar amd64: main/libs/optional/100% -> universe
librte-baseband-acc23 22.11.1-2 in lunar arm64: main/libs/optional/100% -> universe
librte-baseband-acc23 22.11.1-2 in lunar ppc64el: main/libs/optional/100% -> universe
librte-baseband-acc23 22.11.1-2 in lunar riscv64: main/libs/optional/100% -> universe
librte-baseband-fpga-5gnr-fec23 22.11.1-2 in lunar amd64: main/libs/optional/100% -> universe
librte-baseband-fpga-5gnr-fec23 22.11.1-2 in lunar arm64: main/libs/optional/100% -> universe
librte-baseband-fpga-5gnr-fec23 22.11.1-2 in lunar ppc64el: main/libs/optional/100% -> universe
librte-baseband-fpga-5gnr-fec23 22.11.1-2 in lunar riscv64: main/libs/optional/100% -> universe
librte-baseband-fpga-lte-fec23 22.11.1-2 in lunar amd64: main/libs/optional/100% -> universe
librte-baseband-fpga-lte-fec23 22.11.1-2 in lunar arm64: main/libs/optional/100% -> universe
librte-baseband-fpga-lte-fec23 22.11.1-2 in lunar ppc64el: main/libs/optional/100% -> universe
librte-baseband-fpga-lte-fec23 22.11.1-2 in lunar riscv64: main/libs/optional/100% -> universe
librte-baseband-la12xx23 22.11.1-2 in lunar amd64: main/libs/optional/100% -> universe
librte-baseband-la12xx23 22.11.1-2 in lunar arm64: main/libs/optional/100% -> universe
librte-baseband-la12xx23 22.11.1-2 in lunar ppc64el: main/libs/optional/100% -> universe
librte-baseband-la12xx23 22.11.1-2 in lunar...

[Christian Ehrhardt  (paelzer)]

Collectd and DPDK have transitioned.

- UHD waits on numpy/python3.11 to complete, but is otherwise good.
- openvswitch waits on a bad test and more importantly libxdp1 MIR process that was just started

Once UHD and openvswitch transitioned the old NBS of all librte*22 can be removed.
All is corectly shown on https://people.canonical.com/~ubuntu-archive/nbs.html for now.

[Christian Ehrhardt  (paelzer)]

openvswitch migrated as well.
Just UHD is left, but it is ok except waiting for numpy and python-defaults to be ready.

Then we can clean the old dpdk binaries and are done.

[Christian Ehrhardt  (paelzer)]

Update: numpy seems resolved but python-defaults not yet

[Christian Ehrhardt  (paelzer)]

UHD moved as well due to python 3.11 moving.

I checked the NBS report and it is not having any traces of DPDK left.

To be sure I checked one example lib, and it is correct only in J/K
$ rma librte-baseband-la12xx22
 librte-baseband-la12xx22 | 21.11-1build1 | jammy/universe | amd64, arm64, ppc64el
 librte-baseband-la12xx22 | 21.11.2-0ubuntu0.22.04.1 | jammy-security/universe | amd64, arm64, ppc64el
 librte-baseband-la12xx22 | 21.11.2-0ubuntu0.22.04.1 | jammy-updates/universe | amd64, arm64, ppc64el
 librte-baseband-la12xx22 | 21.11.2-0ubuntu1 | kinetic/universe | amd64, arm64, ppc64el

Thereby - completely done