Stable Release Updates Summer 2019 Disco->18.11.2 Bionic->17.11.6

[Christian Ehrhardt ]

This bug tracks an update for the DPDK packages, version 18.11.2 (Disco) 17.11.6 (Bionic).

This update includes bugfixes only following the SRU policy exception defined at https://wiki.ubuntu.com/StableReleaseUpdates/DPDK.

No new features added, a classic stable release with a bunch of fixes aggregated and enhanced testing by the companies being part of the DPDK community.

[Impact]

Stable release update so not directly applicable; see the exception policy document linked above.

[Major Changes]

for 18.11:
18.11.1 https://doc.dpdk.org/guides-18.11/rel_notes/release_18_11.html#release-notes
18.11.2 https://doc.dpdk.org/guides-18.11/rel_notes/release_18_11.html#id1

for 17.11:
17.11.6 https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id6

[Test Plan]

See https://wiki.ubuntu.com/StableReleaseUpdates/DPDK#SRU_TestVerify
TODO: attach a log of executing said tests from a ppa with the upload
TODO: if there are any non passing tests - explain why that is ok in this case.

[Regression Potential]

Upstream performs extensive testing before release, giving us a high degree of confidence in the general case. There problems are most likely to manifest in Ubuntu-specific integrations, such as in relation to the versions of dependencies available and other packaging-specific matters.

[Christian Ehrhardt  (paelzer)]

We switched the development of deb_dpdk from gerrit to salsa.
So this includes the first MPs there, lets see how that works.

[Christian Ehrhardt  (paelzer)]

18.11.2 is building in PPA [1] and 17.11.6 is in review at Debian [2][3][4].

[1]: https://launchpad.net/~paelzer/+archive/ubuntu/bug-1836365-dpdk-stable-summer-2019
[2]: https://salsa.debian.org/debian/dpdk/merge_requests/3
[3]: https://salsa.debian.org/debian/dpdk/merge_requests/4
[4]: https://salsa.debian.org/debian/dpdk/merge_requests/5

[Christian Ehrhardt  (paelzer)]

hmm I never hit send on this, it is actually a bit older ...

Changes in Debian accepted.
Bionic branch ready and building in the PPA [1] as well now.

Testing will start after build is complete.
MPs already ready for review at [2][3].

[1]: https://launchpad.net/~paelzer/+archive/ubuntu/bug-1836365-dpdk-stable-summer-2019
[2]: https://code.launchpad.net/~paelzer/ubuntu/+source/dpdk/+git/dpdk/+merge/370133
[3]: https://code.launchpad.net/~paelzer/ubuntu/+source/dpdk/+git/dpdk/+merge/370134

[Christian Ehrhardt  (paelzer)]

Disco MP review is approved.
Still waiting on Bionic.

Other tests are now complete and freed up the machine, I'll prep the test results that we need along these uploads now ...

[Christian Ehrhardt  (paelzer)]

(After some fixups in the test due to the environment of the system changing swicth setup and having new dhcp servers) the test results for Bionic are good now:

  1.1.0 (10:28:34): initialize environment
3.0.0 (10:29:42): performance tests
  3.1.0 (10:29:42): prep benchmarks
  3.2.0 (10:30:01): performance tests
    3.2.1 (10:30:06): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (10:49:08): test guest-dpdk-vhost-user-singleq for OVSDPDK => Pass
    3.2.3 (11:08:19): test guest-dpdk-vhost-user-multiq for OVSDPDK-tuned => Pass
    3.2.4 (11:28:10): test guest-dpdk-vhost-user-client-multiq for OVSDPDK-VUC => Pass
4.0.0 (11:47:29): endurance checks
  4.1.0 (11:47:29): prep endurance tests
    4.1.1 (11:56:53): start stop guests (server) => Pass
    4.1.2 (13:17:21): add/remove ports (server) => Pass
5.0.0 (13:29:55): VUC endurance checks
  5.1.0 (13:29:55): prep VUC endurance tests
    5.1.1 (13:40:21): start stop guests (client) => Pass
    5.1.2 (15:11:17): add/remove ports (client) => Pass
  5.2.0 (15:23:54): Final cleanup

[Christian Ehrhardt  (paelzer)]

1.0.0 (05:00:11): phys (BM) tests
  1.1.0 (05:00:11): initialize environment
    1.1.1 (05:01:25): testpmd => Pass
    1.1.2 (05:02:20): check testpmd output => Pass
  1.2.0 (05:02:20): Final cleanup

1.0.0 (13:38:53): virt tests
  1.1.0 (13:38:53): initialize environment
3.0.0 (13:39:40): performance tests
  3.1.0 (13:39:40): prep benchmarks
  3.2.0 (13:40:00): performance tests
    3.2.1 (13:40:14): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (13:44:15): test guest-dpdk-vhost-user-client-multiq for OVSDPDK-VUC => Pass
4.0.0 (14:06:29): VUC endurance checks
  4.1.0 (14:06:29): prep VUC endurance tests
    4.1.1 (14:16:23): start stop guests (client) => Pass
    4.1.2 (15:33:02): add/remove ports (client) => Pass
  4.2.0 (15:45:43): Final cleanup+ echo ''

Note: both sections executed on different days

[Christian Ehrhardt  (paelzer)]

With that all pre-reqs for the stable update as documented are complete.
Uploading to -unapproved ...

[Łukasz Zemczak (sil2100)]

Hello Christian, or anyone else affected,

Accepted dpdk into disco-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/dpdk/18.11.2-1ubuntu0.19.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-disco to verification-done-disco. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-disco. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Łukasz Zemczak (sil2100)]

Hello Christian, or anyone else affected,

Accepted dpdk into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/dpdk/17.11.6-0~ubuntu18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Christian Ehrhardt  (paelzer)]

As usual the same regression test run is done on -proposed.
Bionic now completed ...

BENCH_OVSDPDK
BENCH_OVSDPDK_TUNED
ENDURANCE_STARTSTOP
ENDURANCE_ADDREMOVEPORT
VUC_BENCH_OVSDPDK
VUC_ENDURANCE_STARTSTOP
VUC_ENDURANCE_ADDREMOVEPORT

1.0.0 (13:56:38): phys (BM) tests
  1.1.0 (13:56:38): initialize environment
    1.1.1 (13:59:40): testpmd => Pass
    1.1.2 (14:00:24): check testpmd output => Pass
2.0.0 (14:00:24): prep virtual test environment

1.0.0 (14:02:21): virt tests
  1.1.0 (14:02:21): initialize environment
3.0.0 (14:03:13): performance tests
  3.1.0 (14:03:13): prep benchmarks
  3.2.0 (14:04:42): performance tests
    3.2.1 (14:04:49): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (14:23:50): test guest-dpdk-vhost-user-singleq for OVSDPDK => Pass
    3.2.3 (14:42:47): test guest-dpdk-vhost-user-multiq for OVSDPDK-tuned => Pass
    3.2.4 (15:02:36): test guest-dpdk-vhost-user-client-multiq for OVSDPDK-VUC => Pass
4.0.0 (15:21:51): endurance checks
  4.1.0 (15:21:51): prep endurance tests
    4.1.1 (15:31:50): start stop guests (server) => Pass
    4.1.2 (16:54:43): add/remove ports (server) => Pass
5.0.0 (17:07:26): VUC endurance checks
  5.1.0 (17:07:26): prep VUC endurance tests
    5.1.1 (17:17:52): start stop guests (client) => Pass
    5.1.2 (18:50:01): add/remove ports (client) => Pass
  5.2.0 (19:02:48): Final cleanup

[Christian Ehrhardt  (paelzer)]

Disco

VIRT_SPAWNGUESTS
VIRT_TESTPMD
VIRT_L2FWD
BENCH_OVS
VUC_BENCH_OVSDPDK
VUC_ENDURANCE_STARTSTOP
VUC_ENDURANCE_ADDREMOVEPORT

1.0.0 (13:22:58): phys (BM) tests
  1.1.0 (13:22:58): initialize environment
    1.1.1 (13:28:24): testpmd => Pass
    1.1.2 (13:29:29): check testpmd output => Pass
2.0.0 (13:29:29): prep virtual test environment

1.0.0 (13:31:30): virt tests
  1.1.0 (13:31:30): initialize environment
3.0.0 (13:32:01): performance tests
  3.1.0 (13:32:01): prep benchmarks
  3.2.0 (13:32:21): performance tests
    3.2.1 (13:32:35): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (13:51:13): test guest-dpdk-vhost-user-client-multiq for OVSDPDK-VUC => Pass
4.0.0 (14:10:46): VUC endurance checks
  4.1.0 (14:10:46): prep VUC endurance tests
    4.1.1 (14:20:31): start stop guests (client) => Pass
    4.1.2 (15:34:22): add/remove ports (client) => Pass
  4.2.0 (15:46:58): Final cleanup

Note: if you wonder about the different in tests, in later versions the usage of other conenctions than "user-client" are deprecated (and later dropped entirely).

Per the results the SRU verification is complete - setting tags.

[Brian Murray (brian-murray)]

The verification of the Stable Release Update for dpdk has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Launchpad Janitor (janitor)]

This bug was fixed in the package dpdk - 17.11.6-0~ubuntu18.04.1

---------------
dpdk (17.11.6-0~ubuntu18.04.1) bionic; urgency=medium

  * New upstream release 17.11.6 (LP: #1836365)
    For a full list of changes see:
    https://doc.dpdk.org/guides-17.11/rel_notes/release_17_11.html#id6
    - drop patches upstream in 17.11.6:
      d/p/0001-kni-fix-build-for-dev_open-in-Linux-5.0.patch
      d/p/0002-kni-fix-build-for-igb_ndo_bridge_setlink-in-Linux-5..patch
  * d/p/lp-1827102-kni-fix-build-with-Linux-5.1.patch fix kni DKMS build with
    Linux 5.1 kernels (LP: #1827102)

 -- Christian Ehrhardt <email address hidden> Fri, 12 Jul 2019 15:03:53 +0200

[Launchpad Janitor (janitor)]

This bug was fixed in the package dpdk - 18.11.2-1ubuntu0.19.04.1

---------------
dpdk (18.11.2-1ubuntu0.19.04.1) disco; urgency=medium

  * Make DPDK LTS release available in Disco (LP: #1836365)
    - includes a fix for mlx rdma-core dependencies (LP: #1820957)

dpdk (18.11.2-1) experimental; urgency=medium

  [ Christian Ehrhardt ]
  * Merge stable update to 18.11.2; For a list of changes see
    http://doc.dpdk.org/guides-18.11/rel_notes/release_18_11.html#id1
    - refresh 0004-build-bump-minimum-Meson-version-to-0.47.1.patch for 18.11.2
    - drop changes upstream in 18.11.2
      0002-build-use-generic-march-on-arm64-when-using-default.patch
      lp-1827102-kni-fix-build-with-Linux-5.1.patch

  [ Santiago Ruano Rincón ]
  * debian/rules: clean doc files

dpdk (18.11.1-3) experimental; urgency=medium

  * d/control: add dependencies to libdpdk-dev: libelf-dev and libjansson-dev
    to avoid pkg-config issues
  * d/control: drop unused build dependency to libcap-dev

dpdk (18.11.1-2) experimental; urgency=medium

  [ Christian Ehrhardt ]
  * d/control: drop shlibs:Depends from dpdk as it has no binaries anymore
  * d/p/lp-1827102-kni-fix-build-with-Linux-5.1.patch fix kni DKMS build with
    Linux 5.1 kernels (LP: #1827102)

  [ Luca Boccassi ]
  * Bump Standards-Version to 4.3.0, no changes.

dpdk (18.11.1-1) experimental; urgency=medium

  [ Christian Ehrhardt ]
  * Merge stable update to 18.11.1; For a list of changes see
    https://doc.dpdk.org/guides-18.11/rel_notes/release_18_11.html
    - refresh 0004-build-bump-minimum-Meson-version-to-0.47.1.patch for 18.11.1
    - drop changes upstream in 18.11.1
      0001-doc-fix-garbage-text-in-generated-HTML-guides.patch
      0003-build-mention-march-in-pkg-config-description.patch
      0001-kni-fix-build-for-dev_open-in-Linux-5.0.patch
      0002-kni-fix-build-for-igb_ndo_bridge_setlink-in-Linux-5..patch
  * d/control: fix usability issue with mlx PMDs which might need rdma-core
    to be installed. In most cases users will want this, to be able to
    drop rdma-core if unwanted in some cases this is only a recommends added
    to librte-pmd-mlx4-18.11 and librte-pmd-mlx5-18.11 (Closes: #925141)

 -- Christian Ehrhardt <email address hidden> Fri, 12 Jul 2019 14:35:59 +0200