sru curtin 2021-02-18 - 21.2-0ubuntu1

[dann frazier]

[ <dannf> Should we request that the MAAS testing portion of curtin's
          SRU Special Case Exception be omitted for >= focal, since
          MAAS has migrated to a snap there, and MAAS PPAs provide
          their own curtin builds? ]

[ <dannf> This template is seeded by a cut & paste of the last SRU bug
          I found, bug 1881003. ]

== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these improvements.

See the changelog entry below for a full list of changes and bugs.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CurtinUpdates

Curtin now contains an extensive integration test suite that is ran using
the SRU package for each releases. These suite has documentation here:
https://curtin.readthedocs.io/en/latest/topics/integration-testing.html

In order to avoid regression to existing MAAS product, the MAAS team will
run their continuous integration test against the curtin that is in
-proposed. A successful run will be required before the proposed curtin
can be let into -updates.

The curtin team will be in charge of attaching the artifacts and console
output of the appropriate run to the bug. Curtin team members will not
mark ‘verification-done’ until this has happened.

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

== End SRU Template ==
* New upstream release.
  - Release 21.2 [Michael Hudson-Doyle] (LP: #1913357)
  - Revert "apt_config: stop using the deprecated apt-key command"
    [Michael Hudson-Doyle] (LP: #1912801)
  - partition_handler: fix NameError when reusing a vtoc partition
    [Michael Hudson-Doyle]
  - install_grub: convert in-target EFI loader path to ESP path.
    [Dimitri John Ledkov] (LP: #1906379)
  - block: fixes for verifying existing multipath partitions
    [Michael Hudson-Doyle]
  - multipath: use udev DM_NAME for find_mpath_id, fix 4k sector calc
    [Michael Hudson-Doyle] (LP: #1878041)
* New upstream release.
  - Release 21.1 [Michael Hudson-Doyle] (LP: #1911841)
  - This adds arm64 compatibility for RH installations [Mark Klein]
  - vmtest: add Hirsute release classes, tool to add vmtest class
    [Ryan Harper]
  - vmtest: fix image-sync after maas URL stream rename
    [Ryan Harper] (LP: #1908543)
  - storage_config: set ptable to vtoc for 'virt' dasds as well as 'ECKD'
    [Michael Hudson-Doyle]
  - install_grub: Fix bootloader-id for RHEL systems, must be redhat
    [Ryan Harper] (LP: #1906543)
  - vmtests: remove LP: #1888726 skip_by_date decorators
  - storage_config: only produce type: dasd actions for ECKD dasds
    [Michael Hudson-Doyle]
  - storage_config: handle some FBA dasd oddities [Michael Hudson-Doyle]
  - apt_config: stop using the deprecated apt-key command
    [Nishanth Aravamudan] (LP: #1892494)
  - allow adding a vtoc partition without a device id [Michael Hudson-Doyle]
  - simplify dasdview parsing code [Michael Hudson-Doyle]
  - fix construction of DasdPartitionTable from fdasd output
    [Michael Hudson-Doyle]
  - Don't install grub if it is already found on CentOS/RHEL
    [Lee Trager] (LP: #1895067)
  - vmtests: Replace newly added Eoan test with Groovy [Ryan Harper]
  - vmtests: test using a disk with RAID partition on it directly in a RAID
    [Michael Hudson-Doyle]
  - fix verification of vtoc partitions [Michael Hudson-Doyle] (LP: #1899471)
  - create an empty vtoc in disk_handler [Michael Hudson-Doyle]
  - remove unused parameters from dasd code [Michael Hudson-Doyle]
  - remove support for calling get_path_to_storage_volume on a dasd action
    [Michael Hudson-Doyle]
  - clear-holders: fix identification of multipath partitions
    [Ryan Harper] (LP: #1900900)
  - vmtests: remove skip_by_dates for now-fixed bcache issue
  - debian/rules: drop PKG_VERSION and UPSTREAM_VERSION [Paride Legovini]
  - deb packaging: fully cleanup directory tree after build
    [Paride Legovini] (LP: #1899698)
  - udevadm_info should use maxsplit=1 instead of maxsplit=2
    [Sergey Bykov] (LP: #1895021)
  - vmtests/multipath-lvm: dont assume device-mapper block names
    [Ryan Harper] (LP: #1898758)
  - vmtest: fix the groovy arm64 subarch [Paride Legovini] (LP: #1898757)
  - tools/curtainer: dearmor gpg key and use apt-key add
    [Ryan Harper] (LP: #1898609)
  - Support imsm external metadata RAID containers
    [Gyorgy Szombathelyi] (LP: #1893661)
  - Drop tools/new-upstream-snapshot [Paride Legovini]
* New upstream release.
  - Release 20.2 (LP: #1896947)
    - Handle multiple separators which were found in TestAllindata vmtest
    - verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
    - net_meta: add disabled mode to skip writing any network config
      [Lucas Moura]
    - vmtest: trigger guest panic to fail fast
    - Replace grub-shell-helper with install_grub command
    - vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
    - Replace references to old team manager with new team manager
      [James Falcon]
    - tox: pin flake8 to version and add a tip-flake8 environment
      [Paride Legovini]
    - Fix flake8 E741 warning [Lucas Moura]
    - Makefile: make adjustments to call lint/style tools via python module
    - block-discover: ignore invalid id_serial/id_wwn values
    - Fix handing of reusing msdos partitions and flags
    - block.detect_multipath: ignore fake "devices" from /proc/mounts
      [Michael Hudson-Doyle]
    - udev: use shlex.quote when shlex.split errors on shell-escape chars
    - lvm: don't use vgscan --mknodes
    - vmtest: rsync don't cross filesystem boundaries when copying
    - vmtest: basic/basic_scsi adjust collect/tests for unstable device names
    - Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
    - multipath: attempt to enforce /dev/mapper/mpath files are symlinks
    - block-meta: device mapper partitions may be block devices not links
    - Default to dm_name being id if empty earlier in dm_crypt_handler()
      [Łukasz 'sil2100' Zemczak]
    - storage: correct declared schema draft version for storage schema
    - test_clear_holders: add missing zfs mock
    - Mock out zfs_supported to prevent attempting to load kernel modules
    - block-meta: skip wipe device paths if not present
    - unittest: do not allow util.subp by default
    - curthooks: support multiple ESP on UEFI bootable systems
    - block-discover: handle missing multipath 'path' data, use DM_NAME
    - lvm-over-multipath: handle lookups of multipath members
    - block-meta: don't filter preserve=true devices, select by wipe
    - vmtest: basic use dname to lookup disk with multiple partitions
    - block-meta: Don't check the ptable type of a disk with no ptable
    - curthooks: always use ChrootableTarget.subp when calling efibootmgr
    - storage: enable and use multipath during storage configuration
    - block-discover: detect nvme multipath devices
    - clear-holders: Tolerate vgchange errors during discovery
    - block-meta: handle preserve with vtoc ptable
    - vmtest: use -partition file for TestReuseRAIDMemberPartition class
    - format: extra_options should be a list type
    - tox: add pyflakes to the default tox run [Paride Legovini]
    - storage_config: Add 'extra_options' parameter to allow custom mkfs
    - Add support for installing Ubuntu Core 20 images
    - tox.ini: Fix issues with newer tox on focal
    - vmtest: Fix test_basic.py to run on s390x
    - vmtest: use util.load_file for loading collect files
    - block-meta: refactor storage_config preserve and wipe settings
    - block-discover: skip 'multipath' key in blockdevice if mpath name is None
    - tox: all py27 environments should use the base py27 deps
    - uefi: refactor efibootmg handling to support removing duplicate entries
    - tox: pin setuptools < 45 to allow installing py27 in virtenv
  - Fix the py3 pylint ci run [Paride Legovini]

* New upstream snapshot. (LP: #1881003)
- vmtests: update skiptests
- vmtest: allow installed centos images to reboot (LP: #1881011)
- Release 20.1 (LP: #1880741)
- Handle multiple separators which were found in TestAllindata vmtest
- verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
  (LP: #1878890)
- net_meta: add disabled mode to skip writing any network config
  [Lucas Moura]
- vmtest: trigger guest panic to fail fast
- Replace grub-shell-helper with install_grub command
- vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
- Replace references to old team manager with new team manager
  [James Falcon]
- tox: pin flake8 to version and add a tip-flake8 environment
  [Paride Legovini]
- Fix flake8 E741 warning [Lucas Moura]
- Makefile: make adjustments to call lint/style tools via python module
- block-discover: ignore invalid id_serial/id_wwn values (LP: #1876848)
- Fix handing of reusing msdos partitions and flags (LP: #1875903)
- block.detect_multipath: ignore fake "devices" from /proc/mounts
  [Michael Hudson-Doyle] (LP: #1876626)
- udev: use shlex.quote when shlex.split errors on shell-escape chars
  (LP: #1875085)
- lvm: don't use vgscan --mknodes
- vmtest: rsync don't cross filesystem boundaries when copying
  (LP: #1873909)
- vmtest: basic/basic_scsi adjust collect/tests for unstable device names
  (LP: #1874100)
- Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
- multipath: attempt to enforce /dev/mapper/mpath files are symlinks
- block-meta: device mapper partitions may be block devices not links
- Default to dm_name being id if empty earlier in dm_crypt_handler()
  [Łukasz 'sil2100' Zemczak] (LP: #1874243)
- storage: correct declared schema draft version for storage schema
- test_clear_holders: add missing zfs mock
- Mock out zfs_supported to prevent attempting to load kernel modules
- block-meta: skip wipe device paths if not present (LP: #1869075)
- unittest: do not allow util.subp by default (LP: #1873913)
- curthooks: support multiple ESP on UEFI bootable systems
- block-discover: handle missing multipath 'path' data, use DM_NAME
  (LP: #1873728)
- lvm-over-multipath: handle lookups of multipath members (LP: #1869075)
- block-meta: don't filter preserve=true devices, select by wipe
  (LP: #1837214)
- vmtest: basic use dname to lookup disk with multiple partitions
- block-meta: Don't check the ptable type of a disk with no ptable
- curthooks: always use ChrootableTarget.subp when calling efibootmgr
- storage: enable and use multipath during storage configuration
  (LP: #1869075)
- block-discover: detect nvme multipath devices (LP: #1868109)
- clear-holders: Tolerate vgchange errors during discovery (LP: #1870037)
- block-meta: handle preserve with vtoc ptable (LP: #1871158)
- vmtest: use -partition file for TestReuseRAIDMemberPartition class
- format: extra_options should be a list type
- tox: add pyflakes to the default tox run [Paride Legovini]
- storage_config: Add 'extra_options' parameter to allow custom mkfs
  (LP: #1869069)
- Add support for installing Ubuntu Core 20 images
- tox.ini: Fix issues with newer tox on focal
- vmtest: Fix test_basic.py to run on s390x (LP: #1866663)
- vmtest: use util.load_file for loading collect files
- block-meta: refactor storage_config preserve and wipe settings
  (LP: #1837214)
- block-discover: skip 'multipath' key in blockdevice if mpath name is None
- tox: all py27 environments should use the base py27 deps
- uefi: refactor efibootmg handling to support removing duplicate entries
  (LP: #1864257)
- tox: pin setuptools < 45 to allow installing py27 in virtenv
- block-discover: add dasd parser and emit dasd storage config
  (LP: #1862849)

[Brian Murray (brian-murray)]

The Groovy Gorilla has reached end of life, so this bug will not be fixed for that release