sru curtin 2020-05-27 - 20.1-0ubuntu1

Bug #1881003 reported by Ryan Harper on 2020-05-27
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
curtin (Ubuntu)
Undecided
Unassigned
Xenial
Undecided
Unassigned
Bionic
Undecided
Unassigned
Focal
Undecided
Unassigned

Bug Description

== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these improvements.
The notable ones are:

   *

See the changelog entry below for a full list of changes and bugs.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CurtinUpdates

Curtin now contains an extensive integration test suite that is ran using
the SRU package for each releases. These suite has documentation here:
https://curtin.readthedocs.io/en/latest/topics/integration-testing.html

In order to avoid regression to existing MAAS product, the MAAS team will
run their continuous integration test against the curtin that is in
-proposed. A successful run will be required before the proposed curtin
can be let into -updates.

The curtin team will be in charge of attaching the artifacts and console
output of the appropriate run to the bug. Curtin team members will not
mark ‘verification-done’ until this has happened.

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

<TODO: attach curtin-proposed test artifacts from vmtest for every SRU release, not a link as links expire>
<TODO: attach maas-proposed test artifacts from vmtest for every SRU release, not a link as links expire>

[Discussion]
<TODO: other background>

== End SRU Template ==
* New upstream snapshot. (LP: #1881003)
- vmtests: update skiptests
- vmtest: allow installed centos images to reboot (LP: #1881011)
- Release 20.1 (LP: #1880741)
- Handle multiple separators which were found in TestAllindata vmtest
- verify_ptable_flag: dos primary partitions use ptable_uuid map for flag
  (LP: #1878890)
- net_meta: add disabled mode to skip writing any network config
  [Lucas Moura]
- vmtest: trigger guest panic to fail fast
- Replace grub-shell-helper with install_grub command
- vmtest-sync-images: update the URL of the maas streams [Paride Legovini]
- Replace references to old team manager with new team manager
  [James Falcon]
- tox: pin flake8 to version and add a tip-flake8 environment
  [Paride Legovini]
- Fix flake8 E741 warning [Lucas Moura]
- Makefile: make adjustments to call lint/style tools via python module
- block-discover: ignore invalid id_serial/id_wwn values (LP: #1876848)
- Fix handing of reusing msdos partitions and flags (LP: #1875903)
- block.detect_multipath: ignore fake "devices" from /proc/mounts
  [Michael Hudson-Doyle] (LP: #1876626)
- udev: use shlex.quote when shlex.split errors on shell-escape chars
  (LP: #1875085)
- lvm: don't use vgscan --mknodes
- vmtest: rsync don't cross filesystem boundaries when copying
  (LP: #1873909)
- vmtest: basic/basic_scsi adjust collect/tests for unstable device names
  (LP: #1874100)
- Add unittests for partition_handler calc_[dm]_part_info and kpartx paths
- multipath: attempt to enforce /dev/mapper/mpath files are symlinks
- block-meta: device mapper partitions may be block devices not links
- Default to dm_name being id if empty earlier in dm_crypt_handler()
  [Łukasz 'sil2100' Zemczak] (LP: #1874243)
- storage: correct declared schema draft version for storage schema
- test_clear_holders: add missing zfs mock
- Mock out zfs_supported to prevent attempting to load kernel modules
- block-meta: skip wipe device paths if not present (LP: #1869075)
- unittest: do not allow util.subp by default (LP: #1873913)
- curthooks: support multiple ESP on UEFI bootable systems
- block-discover: handle missing multipath 'path' data, use DM_NAME
  (LP: #1873728)
- lvm-over-multipath: handle lookups of multipath members (LP: #1869075)
- block-meta: don't filter preserve=true devices, select by wipe
  (LP: #1837214)
- vmtest: basic use dname to lookup disk with multiple partitions
- block-meta: Don't check the ptable type of a disk with no ptable
- curthooks: always use ChrootableTarget.subp when calling efibootmgr
- storage: enable and use multipath during storage configuration
  (LP: #1869075)
- block-discover: detect nvme multipath devices (LP: #1868109)
- clear-holders: Tolerate vgchange errors during discovery (LP: #1870037)
- block-meta: handle preserve with vtoc ptable (LP: #1871158)
- vmtest: use -partition file for TestReuseRAIDMemberPartition class
- format: extra_options should be a list type
- tox: add pyflakes to the default tox run [Paride Legovini]
- storage_config: Add 'extra_options' parameter to allow custom mkfs
  (LP: #1869069)
- Add support for installing Ubuntu Core 20 images
- tox.ini: Fix issues with newer tox on focal
- vmtest: Fix test_basic.py to run on s390x (LP: #1866663)
- vmtest: use util.load_file for loading collect files
- block-meta: refactor storage_config preserve and wipe settings
  (LP: #1837214)
- block-discover: skip 'multipath' key in blockdevice if mpath name is None
- tox: all py27 environments should use the base py27 deps
- uefi: refactor efibootmg handling to support removing duplicate entries
  (LP: #1864257)
- tox: pin setuptools < 45 to allow installing py27 in virtenv
- block-discover: add dasd parser and emit dasd storage config
  (LP: #1862849)

Ryan Harper (raharper) on 2020-05-28
description: updated

Hello Ryan, or anyone else affected,

Accepted curtin into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/20.1-2-g42a9667f-0ubuntu1~20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in curtin (Ubuntu Focal):
status: New → Fix Committed
tags: added: verification-needed verification-needed-focal
Brian Murray (brian-murray) wrote :

Ubuntu 19.10 does not reach end of life until another 6 weeks or so. Is there a reason curtin was not uploaded for it?

Changed in curtin (Ubuntu Bionic):
status: New → Fix Committed
tags: added: verification-needed-bionic
Brian Murray (brian-murray) wrote :

Hello Ryan, or anyone else affected,

Accepted curtin into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/20.1-2-g42a9667f-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in curtin (Ubuntu Xenial):
status: New → Fix Committed
tags: added: verification-needed-xenial
Brian Murray (brian-murray) wrote :

Hello Ryan, or anyone else affected,

Accepted curtin into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/20.1-2-g42a9667f-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Chad Smith (chad.smith) on 2020-06-11
Changed in curtin (Ubuntu):
status: New → In Progress
John George (jog) wrote :

Solutions-QA has completed our validation using python3-curtin_20.1-2-g42a9667f-0ubuntu1~18.04.1.
Deployment artifacts are available here:
https://solutions.qa.canonical.com/#/testplans/testplaninstance/5c3995e7-6595-414a-9894-885fb0f54748

tags: added: verification-done-bionic
removed: verification-needed-bionic
Dan Watkins (oddbloke) wrote :

Two runs of curtin's CI were performed for xenial: the first, our regular Jenkins run had some tests fail due to bugs in the test code (that have since been fixed upstream), so the second reruns the upstream test code for those tests against the -proposed package.

Dan Watkins (oddbloke) wrote :
Dan Watkins (oddbloke) wrote :
Dan Watkins (oddbloke) wrote :

Three runs of curtin's CI were performed for bionic: the first, our regular Jenkins run had some tests fail due to bugs in the test code (that have since been fixed upstream), so the second reruns the upstream test code for those tests against the -proposed package. This second run had some failures shared with the first run due to a kernel bug (https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1825413), so a third run of those tests was performed on my desktop.

Dan Watkins (oddbloke) wrote :
Dan Watkins (oddbloke) wrote :
Dan Watkins (oddbloke) wrote :
Dan Watkins (oddbloke) wrote :
Dan Watkins (oddbloke) wrote :
Łukasz Zemczak (sil2100) wrote :

What is the state of this upload? I only see the bionic verification tag, and some comments mentioning verification of xenial as well. What about focal? Can someone set the tags appropriately once the verification is finished?

John George (jog) wrote :

Solutions-QA completed validation using python3-curtin_20.1-2-g42a9667f from maas to deploy kubernetes on focal. Deployment artifacts are available here:
https://solutions.qa.canonical.com/#/testplans/testplaninstance/5c3995e7-6595-414a-9894-885fb0f54748

To post a comment you must log in.