[Intel Feature] Update mdadm to the latest upstream version

[quanxian]

1. Feature Overview:
 a) Name of feature:
Update mdadm to the latest upstream version.

 b) Feature Description:
Mdadm is an application that can be used to control Linux MD devices.
It enables Intel Rapid Storage Technology Enterprise on Linux by providing external IMSM metadata handlers for MD RAID.
Also there are several new features that is going to be pushed upstream in near future:
- Spanning functionality for NVMe under VMD domian
- Support for 4Kn drives with IMSM metadata
- Support for Partial Parity Log (alternative Raid Write Hole solution)
- Bad Block Management support for IMSM metadata

1. Feature Details:

 a) Architectures:
64-bit Intel EM64T/AMD64

 b) Bugzilla Dependencies:

 c) Drivers or hardware dependencies:
- Any RAID supporting Intel HW platforms can be used, e.g. ICH9, ICH10, Ibexpeak, Patsburg, Wellsburg, Lewisburg
- MD-RAID driver
- VMD driver

 d) Upstream acceptance information:
mdadm’s extensions including features above are in active development. Final version will be included in Jes Sorensen's GIT repository:
https://git.kernel.org/cgit/utils/mdadm/mdadm.git

Pull request will be triggered on this Bugzilla.

Intel can come back with specific commit requests if needed.

 e) External links:

 f) Severity (H,M,L):
Medium
g) Feature Needed by:

 3. Business Justification:
 a) Why is this feature needed?

 b) What hardware does this enable?

 c) Business impact?

 d) Other business drivers:

1. Primary contact at Canonical, email, phone (chat)
     Mark， Brown
     <email address hidden>

2. Primary contact at Partner, email, phone (chat)
     Quanxian, Wang
     <email address hidden>

[quanxian (quanxian-wang)]

Currently feature submit has been freezed on Feb, 18 for Ubuntu 17.04. The target version is defined to Ubuntu 17.10. If there is any emergency request, please input the comment here, and we will have a discussion with Canonical to make sure if we can make it happen in 17.04.

[Dimitri John Ledkov (xnox)]

Currently, both Debian and Ubuntu are frozen with the v3.4 releases for the upcoming releases of both Operating Systems.

I can look into packaging v4.0 in Debian Experimental, and target for inclusion in 17.10 release.

[quanxian (quanxian-wang)]

This is the list of changes needed by Intel regards to this FEAT request:

Changes from mdadm repository: http://git.kernel.org/pub/scm/utils/mdadm/mdadm.git/

Bad Block management functionality:
bbb52f2b1dd0 Increase buffer for sysfs path
cf52eff58ab9 Increase buffer for sysfs disk state
bb758ccad0e9 mdadm: bad block support for external metadata - initialization
6dc1785fdb1d mdmon: bad block support for external metadata - sysfs file
open
1ab97c976b3f mdmon: bad block support for external metadata - store bad
blocks
42d902d9db08 mdmon: bad block support for external metadata - clear bad
blocks
8d67477fd130 imsm: parse bad block log in metadata on startup
bbab0940fa75 imsm: write bad block log on metadata sync
b12796be0cca imsm: give md list of known bad blocks on startup
6f50473f2595 imsm: record new bad block in bad block log
c07a5a4f410a imsm: clear bad block from bad block log
4c9e8c1ea68c imsm: clear bad blocks if disk becomes unavailable
928f142438a7 imsm: provide list of bad blocks for an array
27156a57ddb8 imsm: implement "--examine-badblocks" command
e4467bc73096 imsm: 4kn support for bad block log

4Kn support for IMSM metadata:
de44e46 IMSM: 4Kn drives support - adapt general migration record
f36a9ec IMSM: Add support for 4Kn sector size drives
fa7bb6f IMSM: Read and store device sector size
3297150 Add function for getting member drive sector size

VMD spanning:
07cb1e5 IMSM: Enable spanning between VMD domains

General BugFixes:
12fe93e9133a imsm: load migration record from right disk
20bee0f IMSM: Add warning message when x8-type device is used
12fe93e imsm: load migration record from right disk
ddab63c Allow level migration only for single-array container
2d2b0eb imsm: block chunk size change for RAID 10
1b7eb67 super1: fix setting bad block log offset in write_init_super1()
561ad55 super1: make internal bitmap size calculations more consistent
52a9408 Lib.c: Fix geting devname for devices with long path
06fb291 IMSM: Update num_data_stripes during migration

Partial Parity Log (RaidWriteHole closure solution):
Patchset: http://marc.info/?l=linux-raid&m=148095194813369&w=2

[quanxian (quanxian-wang)]

860f11ed Grow: support consistency policy change e6e9dd3f Add 'ppl' and 'no-ppl' options for --update=
e97a7cd0 super1: PPL support
2432ce9b imsm: PPL support
65884368 Detail: show consistency policy
5308f117 Generic support for --consistency-policy and PPL
b53bfba6 imsm: use rounded size for metadata initialization

[Leann Ogasawara (leannogasawara)]

Adding a task for mdadm to consider picking up support in 17.10.

[Launchpad Janitor (janitor)]

This bug was fixed in the package mdadm - 4.0-1

---------------
mdadm (4.0-1) unstable; urgency=medium

  * New upstream release. LP: #1668128
  * Drop warnings that raid arrays are missing from the initramfs
    configuration. Instead have a positive message as to which arrays are
    included in the initramfs.
  * Add a warning to mkconf generated file that mdadm.conf is copied into
    initrafms.
  * Fix checkarray script bugs. LP: #1599428 Closes: #787950 Closes: #843665

 -- Dimitri John Ledkov <email address hidden> Thu, 22 Jun 2017 13:23:10 +0100