sru cloud-init (18.2-4-g05926e48-0ubuntu1) to (18.3-9ubuntu1)

Bug #1777912 reported by Chad Smith on 2018-06-20
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
cloud-init (Ubuntu)
Undecided
Unassigned
Xenial
Undecided
Unassigned
Artful
Undecided
Unassigned
Bionic
Undecided
Unassigned

Bug Description

UPDATE: SRU regression found during 18.3.0 -proposed validation. fix is queued present in 18.3.9 for bug https://bugs.launchpad.net/cloud-init/+bug/1780481.

Updated description of changes for minor SRU-update to 18.3 targets Xenial, Artful and Bionic.

 18.2.4 -> 18.3 changeset contains

 - OpenStack now runs at local time frame network config can be rendered from network_data.json if configured "apply_network_config: true".
 - Fix utf-8 content in user-data (LP: #1768600)
 - many SmartOS improvements

== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these
improvements. The notable ones are:

    - Explicitly prevent `sudo` access for user module [Jacob Bednarz]
    - lxd: Delete default network and detach device if lxd-init created them.
    - openstack: avoid unneeded metadata probe on non-openstack platforms
    - stages: fix tracebacks if a module stage is undefined or empty
      [Robert Schweikert]
    - Be more safe on string/bytes when writing multipart user-data to disk.
    - Fix get_proc_env for pids that have non-utf8 content in environment.
    - netplan: fix mtu if provided by network config for all rendered types
    - subp: support combine_capture argument.
    - util: add get_linux_distro function to replace platform.dist
    - Enable SmartOS network metadata to work with netplan via per-subnet
      routes [Dan McDonald]
    - openstack: Allow discovery in init-local using dhclient in a sandbox.
    - yaml_load/schema: Add invalid line and column nums to error message
    - Azure: Ignore NTFS mount errors when checking ephemeral drive
      [Paul Meyer]
    - Update version.version_string to contain packaged version.
    - cc_mounts: Do not add devices to fstab that are already present.
      [Lars Kellogg-Stedman]
    - ds-identify: ensure that we have certain tokens in PATH.
    - read_file_or_url: move to url_helper, fix bug in its FileResponse.
    - ds-identify: recognize container-other as a container, test SmartOS.
    - cloud-config.service: run After snap.seeded.service.
    - SmartOS: fix get_interfaces for nics that do not have addr_assign_type.
    - azure: Add reported ready marker file. [Joshua Chan]
    - FreeBSD: Invoke growfs on ufs filesystems such that it does not prompt.
    - netinfo: fix netdev_pformat when a nic does not have an address assigned.
    - collect-logs: add -v flag, write to stderr, limit journal to single boot.
    - IBMCloud: Disable config-drive and nocloud only if IBMCloud is enabled.
    - Add reporting events and log_time around early source of blocking time
 --- Addtional changelog delta for Xenial, Artful ----
    - net: detect unstable network names and trigger a settle if needed
    - DataSourceSmartOS: add locking of serial device. [Mike Gerdts]
    - DataSourceSmartOS: sdc:hostname is ignored [Mike Gerdts]
    - DataSourceSmartOS: list() should always return a list [Mike Gerdts]
    - schema: in validation, raise ImportError if strict but no jsonschema.
    - set_passwords: Add newline to end of sshd config, only restart if
      updated.
    - Schema: do not warn on duplicate items in commands.
    - net: Depend on iproute2's ip instead of net-tools ifconfig or route
    - DataSourceSmartOS: fix hang when metadata service is down [Mike Gerdts]
    - DataSourceSmartOS: change default fs on ephemeral disk from ext3 to
      ext4. [Mike Gerdts]
    - Implement bash completion script for cloud-init command line
    - renderer: support unicode in render_from_file.
    - Implement ntp client spec with auto support for distro selection
    - Apport: add Brightbox, IBM, LXD, and OpenTelekomCloud to list of clouds.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CloudinitUpdates

The cloud-init team will be in charge of attaching the artifacts and
console output of the appropriate run to the bug. cloud-init team
members will not mark ‘verification-done’ until this has happened.

* Automated Test Results
 - xenial ec2, lxd, nocloud-kvm: attached xenial-integration-console.log xenial-integration-artifacts.tar.xz
 - artful ec2, lxd, nocloud-kvm: attached artful-integration-console.log artful-integration-artifacts.tar.xz
 - bionic ec2, lxd, nocloud-kvm: attached bionic-integration-console.log bionic-integration-artifacts.tar.xz
TODO: attach Solutions Testing team test results for each LTS
sru-artifact-solutions-qa-xenial
TODO: attach MAAS Team test results for each LTS
sru-artifact-maas-xenial

* Manual Test Results
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on ec2 datasource
sru-artifact-manual-ec2
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on gce datasource
sru-artifact-manual-gce
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on azure datasource
sru-artifact-manual-azure

DONE: attach manual cloud-init-proposed test artifacts from tests for each release on openstack datasource
sru-artifact-manual-openstack

DONE: attach manual cloud-init-proposed test artifacts from tests for each release on softlayer datasource
sru-artifact-manual-softlayer

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

[Discussion]
Manual verification artifacts will also be hosted in the folllowing repository:

https://github.com/cloud-init/ubuntu-sru/tree/master/20180620

== End SRU Template ==

== Changelog ==
 - 18.3-9-g2e62cb8a-0ubuntu1

    - docs: note in rtd about avoiding /tmp when writing files
    - ubuntu,centos,debian: get_linux_distro to align with platform.dist
    - Fix boothook docs on environment variable name (INSTANCE_I ->
      INSTANCE_ID) [Marc Tamsky]
    - update_metadata: a datasource can support network re-config every boot
    - tests: drop salt-minion integration test
    - Retry on failed import of gpg receive keys.
    - tools: Fix run-container when neither source or binary package requested.
    - docs: Fix a small spelling error. [Oz N Tiram]
    - tox: use simplestreams from git repository rather than bzr.

 - 18.3-0ubuntu1

    - release 18.3
    - docs: represent sudo:false in docs for user_groups config module
    - Explicitly prevent `sudo` access for user module [Jacob Bednarz]
    - lxd: Delete default network and detach device if lxd-init created them.
    - openstack: avoid unneeded metadata probe on non-openstack platforms
    - stages: fix tracebacks if a module stage is undefined or empty
      [Robert Schweikert]
    - Be more safe on string/bytes when writing multipart user-data to disk.
    - Fix get_proc_env for pids that have non-utf8 content in environment.
    - tests: fix salt_minion integration test on bionic and later
    - tests: provide human-readable integration test summary when --verbose
    - tests: skip chrony integration tests on lxd running artful or older
    - test: add optional --preserve-instance arg to integraiton tests
    - netplan: fix mtu if provided by network config for all rendered types
    - tests: remove pip install workarounds for pylxd, take upstream fix.
    - subp: support combine_capture argument.
    - tests: ordered tox dependencies for pylxd install
    - util: add get_linux_distro function to replace platform.dist
      [Robert Schweikert]
    - pyflakes: fix unused variable references identified by pyflakes 2.0.0.
    - - Do not use the systemd_prefix macro, not available in this environment
      [Robert Schweikert]
    - doc: Add config info to ec2, openstack and cloudstack datasource docs
    - Enable SmartOS network metadata to work with netplan via per-subnet
      routes [Dan McDonald]
    - openstack: Allow discovery in init-local using dhclient in a sandbox.
    - tests: Avoid using https in httpretty, improve HttPretty test case.
    - yaml_load/schema: Add invalid line and column nums to error message
    - Azure: Ignore NTFS mount errors when checking ephemeral drive
      [Paul Meyer]
    - packages/brpm: Get proper dependencies for cmdline distro.
    - packages: Make rpm spec files patch in package version like in debs.
    - tools/run-container: replace tools/run-centos with more generic.
    - Update version.version_string to contain packaged version.
    - cc_mounts: Do not add devices to fstab that are already present.
      [Lars Kellogg-Stedman]
    - ds-identify: ensure that we have certain tokens in PATH.
    - tests: enable Ubuntu Cosmic in integration tests [Joshua Powers]
    - read_file_or_url: move to url_helper, fix bug in its FileResponse.
    - cloud_tests: help pylint
    - flake8: fix flake8 errors in previous commit.
    - typos: Fix spelling mistakes in cc_mounts.py log messages [Stephen Ford]
    - tests: restructure SSH and initial connections [Joshua Powers]
    - ds-identify: recognize container-other as a container, test SmartOS.
    - cloud-config.service: run After snap.seeded.service.
    - tests: do not rely on host /proc/cmdline in test_net.py
      [Lars Kellogg-Stedman]
    - ds-identify: Remove dupe call to is_ds_enabled, improve debug message.
    - SmartOS: fix get_interfaces for nics that do not have addr_assign_type.
    - tests: fix package and ca_cert cloud_tests on bionic
    - ds-identify: make shellcheck 0.4.6 happy with ds-identify.
    - pycodestyle: Fix deprecated string literals, move away from flake8.
    - azure: Add reported ready marker file. [Joshua Chan]
    - tools: Support adding a release suffix through packages/bddeb.
    - FreeBSD: Invoke growfs on ufs filesystems such that it does not prompt.
      [Harm Weites]
    - tools: Re-use the orig tarball in packages/bddeb if it is around.
    - netinfo: fix netdev_pformat when a nic does not have an address assigned.
    - collect-logs: add -v flag, write to stderr, limit journal to single boot.
    - IBMCloud: Disable config-drive and nocloud only if IBMCloud is enabled.
    - Add reporting events and log_time around early source of blocking time
 --- Addtional changelog delta for Xenial, Artful ----
    - IBMCloud: recognize provisioning environment during debug boots.
    - net: detect unstable network names and trigger a settle if needed
    - IBMCloud: improve documentation in datasource.
    - sysconfig: dhcp6 subnet type should not imply dhcpv4 [Vitaly Kuznetsov]
    - packages/debian/control.in: add missing dependency on iproute2.
    - DataSourceSmartOS: add locking of serial device. [Mike Gerdts]
    - DataSourceSmartOS: sdc:hostname is ignored [Mike Gerdts]
    - DataSourceSmartOS: list() should always return a list [Mike Gerdts]
    - schema: in validation, raise ImportError if strict but no jsonschema.
    - set_passwords: Add newline to end of sshd config, only restart if
      updated.
    - pylint: pay attention to unused variable warnings.
    - doc: Add documentation for AliYun datasource. [Junjie Wang]
    - Schema: do not warn on duplicate items in commands.
    - net: Depend on iproute2's ip instead of net-tools ifconfig or route
    - DataSourceSmartOS: fix hang when metadata service is down [Mike Gerdts]
    - DataSourceSmartOS: change default fs on ephemeral disk from ext3 to
      ext4. [Mike Gerdts]
    - pycodestyle: Fix invalid escape sequences in string literals.
    - Implement bash completion script for cloud-init command line
    - tools: Fix make-tarball cli tool usage for development
    - renderer: support unicode in render_from_file.
    - Implement ntp client spec with auto support for distro selection
    - Apport: add Brightbox, IBM, LXD, and OpenTelekomCloud to list of clouds.
    - tests: fix ec2 integration network metadata validation

Chad Smith (chad.smith) on 2018-06-20
summary: - sru cloud-init (18.2-4-g05926e48-0ubuntu1~16.04.2) to
- (18.3-0ubuntu1~16.04.1)
+ sru cloud-init (18.2-4-g05926e48-0ubuntu1) to (18.3-0ubuntu1)
description: updated
description: updated
description: updated
Chad Smith (chad.smith) on 2018-06-20
description: updated

Hello Chad, or anyone else affected,

Accepted cloud-init into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.3-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in cloud-init (Ubuntu Bionic):
status: New → Fix Committed
tags: added: verification-needed verification-needed-bionic
Brian Murray (brian-murray) wrote :

Hello Chad, or anyone else affected,

Accepted cloud-init into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.3-0ubuntu1~17.10.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in cloud-init (Ubuntu Artful):
status: New → Fix Committed
tags: added: verification-needed-artful
Changed in cloud-init (Ubuntu Xenial):
status: New → Fix Committed
tags: added: verification-needed-xenial
Brian Murray (brian-murray) wrote :

Hello Chad, or anyone else affected,

Accepted cloud-init into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.3-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Scott Moser (smoser) on 2018-06-29
description: updated

Blocked this SRU on a regression that causes xenial to choose the wrong ntp default client
https://bugs.launchpad.net/cloud-init/+bug/1780481

description: updated
Chad Smith (chad.smith) on 2018-07-10
description: updated
tags: added: regression-proposed

Hello Chad, or anyone else affected,

Accepted cloud-init into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.3-9-g2e62cb8a-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Steve Langasek (vorlon) wrote :

Hello Chad, or anyone else affected,

Accepted cloud-init into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.3-9-g2e62cb8a-0ubuntu1~17.10.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Steve Langasek (vorlon) wrote :

Hello Chad, or anyone else affected,

Accepted cloud-init into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.3-9-g2e62cb8a-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Chad Smith (chad.smith) on 2018-07-10
summary: - sru cloud-init (18.2-4-g05926e48-0ubuntu1) to (18.3-0ubuntu1)
+ sru cloud-init (18.2-4-g05926e48-0ubuntu1) to (18.3-9ubuntu1)
Scott Moser (smoser) on 2018-07-11
description: updated
description: updated
Scott Moser (smoser) wrote :

Note that the artful results attachment in comment 19 did actually fail.
However, the failure is a result of bug 1779302.

Chad Smith (chad.smith) wrote :

ec2 manual verification results xenial, artful bionic

Chad Smith (chad.smith) wrote :

openstack manual verification results xenial, artful bionic

Chad Smith (chad.smith) wrote :

azure manual verification results xenial, artful bionic

Chad Smith (chad.smith) wrote :

gce manual verification results xenial, artful bionic

description: updated
description: updated

Attach file softlayer-xenial.tar.gz.

Attach file softlayer-bionic.tar.gz.

Scott Moser (smoser) on 2018-07-13
description: updated
tags: added: verification-done-artful
removed: verification-needed-artful
Scott Moser (smoser) wrote :

I've marked verification-done-artful based on logs above and content at
https://github.com/cloud-init/ubuntu-sru/tree/master/20180620

We are waiting on lts results for
* TODO: attach Solutions Testing team test results for each LTS sru-artifact-solutions-qa-xenial
* TODO: attach MAAS Team test results for each LTS sru-artifact-maas-xenial

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers

Bug attachments