sru cloud-init (18.3.9-g2e62cb8a-0ubuntu1) to (18.4-0ubuntu1)

[Chad Smith]

== Begin SRU Template ==
[Updates 10/17/2018]
  SRU regression in behavior found on Xenial(Azure) which needs to retain original behavior with generated network_config. (LP: #1798424)
   Fix is proposed and uploaded as 18.4-0ubuntu1~16.04.2

[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these
improvements. The notable ones that affect Ubuntu are:

 - Add support for Infiniband network interfaces (IPoIB). [Mark Goddard]
 - cli: add cloud-init query subcommand to query instance metadata
 - OpenStack: Support setting mac address on bond.
      [Fabian Wiesel] (LP: #1682064)
 - EphemeralIPv4Network: Be more explicit when adding default route.
      (LP: #1792415)
 - OpenStack: support reading of newer versions of metdata.
 - OpenStack: fix bug causing 'latest' version to be used from network.
      (LP: #1792157)
 - user-data: jinja template to render instance-data.json in cloud-config
      (LP: #1791781)
 - config: disable ssh access to a configured user account
 - sysconfig: refactor sysconfig to accept distro specific templates paths
 - hyperv_reporting_handler: simplify threaded publisher
 - VMWare: Fix a network config bug in vm with static IPv4 and no gateway.
      [Pengpeng Sun] (LP: #1766538)
 - logging: Add logging config type hyperv for reporting via Azure KVP
      [Andy Liu]
 - Add oracle datasource to debian/cloud-init.templates
 - Add datasource Oracle Compute Infrastructure (OCI).
 - azure: allow azure to generate network configuration from IMDS per boot.
 - Scaleway: Add network configuration to the DataSource [Louis Bouchard]
      [Wesley Gao]
 - netplan: Correctly render macaddress on a bonds and bridges when
      provided. (LP: #1784699)
 - tools: Add 'net-convert' subcommand command to 'cloud-init devel'.
 - Use typeset or local in profile.d scripts. (LP: #1784713)
 - OpenNebula: Fix null gateway6 [Akihiko Ota] (LP: #1768547)
 - oracle: fix detect_openstack to report True on OracleCloud.com DMI data
      (LP: #1784685)
 - update_metadata re-config on every boot comments and tests not quite
      right [Mike Gerdts]
 - get_linux_distro: add support for centos6 and rawhide flavors of redhat
      (LP: #1781229)

See the changelog entry below for a full list of changes and bugs.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CloudinitUpdates

The cloud-init team will be in charge of attaching the artifacts and
console output of the appropriate run to the bug. cloud-init team
members will not mark ‘verification-done’ until this has happened.

* Automated Test Results
DONE: attach automated cloud-init-proposed test artifacts from tests for each release with lxd artifacts
DONE: attach automated cloud-init-proposed test artifacts from tests for each release with kvm artifacts
DONE: attach automated curtin vmtest with cloud-init proposed
DONE: attach Solutions Testing team test results for each LTS

* Manual Test Results
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on ec2 datasource
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on gce datasource
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on azure datasource

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

[Discussion]
Additional manual test results are hosted at https://github.com/cloud-init/ubuntu-sru/tree/master/20181003

== End SRU Template ==

== Complete ChangeLog ==
    - release 18.4
    - tests: allow skipping an entire cloud_test without running.
    - tests: disable lxd tests on cosmic
    - cii-tests: use unittest2.SkipTest in ntp_chrony due to new deps
    - lxd: adjust to snap installed lxd.
    - docs: surface experimental doc in instance-data.json
    - tests: fix ec2 integration tests. process meta_data instead of meta-data
    - Add support for Infiniband network interfaces (IPoIB). [Mark Goddard]
    - cli: add cloud-init query subcommand to query instance metadata
    - tools/tox-venv: update for new features.
    - pylint: ignore warning assignment-from-no-return for _write_network
    - stages: Fix bug causing datasource to have incorrect sys_cfg.
    - Remove dead-code _write_network distro implementations.
    - net_util: ensure static configs have netmask in translate_network result
      [Thomas Berger]
    - Fall back to root:root on syslog permissions if other options fail.
      [Robert Schweikert]
    - tests: Add mock for util.get_hostname. [Robert Schweikert]
    - ds-identify: doc string cleanup.
    - OpenStack: Support setting mac address on bond. [Fabian Wiesel]
    - bash_completion/cloud-init: fix shell syntax error.
    - EphemeralIPv4Network: Be more explicit when adding default route.
    - OpenStack: support reading of newer versions of metdata.
    - OpenStack: fix bug causing 'latest' version to be used from network.
    - user-data: jinja template to render instance-data.json in cloud-config
    - config: disable ssh access to a configured user account
    - tests: print failed testname instead of docstring upon failure
    - tests: Disallow use of util.subp except for where needed.
    - sysconfig: refactor sysconfig to accept distro specific templates paths
    - Add unit tests for config/cc_ssh.py [Francis Ginther]
    - Fix the built-in cloudinit/tests/helpers:skipIf
    - read-version: enhance error message [Joshua Powers]
    - hyperv_reporting_handler: simplify threaded publisher
    - VMWare: Fix a network config bug in vm with static IPv4 and no gateway.
      [Pengpeng Sun]
    - logging: Add logging config type hyperv for reporting via Azure KVP
      [Andy Liu]
    - tests: disable other snap test as well [Joshua Powers]
    - tests: disable snap, fix write_files binary [Joshua Powers]
    - Add datasource Oracle Compute Infrastructure (OCI).
    - azure: allow azure to generate network configuration from IMDS per boot.
    - Scaleway: Add network configuration to the DataSource [Louis Bouchard]
    - docs: Fix example cloud-init analyze command to match output.
      [Wesley Gao]
    - netplan: Correctly render macaddress on a bonds and bridges when
      provided.
    - tools: Add 'net-convert' subcommand command to 'cloud-init devel'.
    - redhat: remove ssh keys on new instance.
    - Use typeset or local in profile.d scripts.
    - OpenNebula: Fix null gateway6 [Akihiko Ota]
    - oracle: fix detect_openstack to report True on OracleCloud.com DMI data
    - tests: improve LXDInstance trying to workaround or catch bug.
    - update_metadata re-config on every boot comments and tests not quite
      right [Mike Gerdts]
    - tests: Collect build_info from system if available.
    - pylint: Fix pylint warnings reported in pylint 2.0.0.
    - get_linux_distro: add support for rhel via redhat-release.
    - get_linux_distro: add support for centos6 and rawhide flavors of redhat
    - tools: add '--debug' to tools/net-convert.py
    - tests: bump the version of paramiko to 2.4.1.

[Timo Aaltonen (tjaalton)]

Hello Chad, or anyone else affected,

Accepted cloud-init into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.4-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Timo Aaltonen (tjaalton)]

Hello Chad, or anyone else affected,

Accepted cloud-init into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.4-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Chad Smith (chad.smith)]

Added a link to Xenial-only SRU regression https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1795953.

This regression should be fixed by a -proposed xenial upload 18.4-0ubuntu1~16.04.2

[Steve Langasek (vorlon)]

Hello Chad, or anyone else affected,

Accepted cloud-init into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/18.4-0ubuntu1~16.04.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

[Chad Smith (chad.smith)]

Xenial proposed automated testing of lxd, nocloud-kvm and ec2 platforms 18.4.0.16.04.2

[Chad Smith (chad.smith)]

Bionic proposed automated testing of lxd, nocloud-kvm and ec2 platforms

[Chad Smith (chad.smith)]

EC2 Xenial and Bionic manual test results

[Chad Smith (chad.smith)]

Azure Xenial and Bionic Manaul test restuls

[Chad Smith (chad.smith)]

GCE Xenial and Bionic Manual test results

[Chad Smith (chad.smith)]

OpenStack Xenial and Bionic Manual test results

[Dimitri John Ledkov (xnox)]

@Chat Smith, so are the test results good? Are you going to "change the tag from verification-needed-bionic to verification-done-bionic" as is required to release this sru?

[Dimitri John Ledkov (xnox)]

@Chat Smith, so are the test results good? Are you going to "change the tag from verification-needed-bionic to verification-done-bionic" as is required to release this sru?

And ditto the xenial tags.

[Scott Moser (smoser)]

@xnox, @blackboxsw,

I've updated the summary.
We were still waiting on solutions QA response.
I've talked to John George and he hopes to get to that today.

[John George (jog)]

KVM and metal install logs from the CDOQA test environment.
Both Xenial and Bionic logs are included.

[Łukasz Zemczak (sil2100)]

The verification of the Stable Release Update for cloud-init has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Launchpad Janitor (janitor)]

This bug was fixed in the package cloud-init - 18.4-0ubuntu1~18.04.1

---------------
cloud-init (18.4-0ubuntu1~18.04.1) bionic-proposed; urgency=medium

  * drop the following cherry-picks now included:
    + cpick-3cee0bf8-oracle-fix-detect_openstack-to-report-True-on
  * refresh patches:
   + debian/patches/openstack-no-network-config.patch
  * New upstream release. (LP: #1795953)
    - release 18.4
    - tests: allow skipping an entire cloud_test without running.
    - tests: disable lxd tests on cosmic
    - cii-tests: use unittest2.SkipTest in ntp_chrony due to new deps
    - lxd: adjust to snap installed lxd.
    - docs: surface experimental doc in instance-data.json
    - tests: fix ec2 integration tests. process meta_data instead of meta-data
    - Add support for Infiniband network interfaces (IPoIB). [Mark Goddard]
    - cli: add cloud-init query subcommand to query instance metadata
    - tools/tox-venv: update for new features.
    - pylint: ignore warning assignment-from-no-return for _write_network
    - stages: Fix bug causing datasource to have incorrect sys_cfg.
    - Remove dead-code _write_network distro implementations.
    - net_util: ensure static configs have netmask in translate_network result
      [Thomas Berger]
    - Fall back to root:root on syslog permissions if other options fail.
      [Robert Schweikert]
    - tests: Add mock for util.get_hostname. [Robert Schweikert]
    - ds-identify: doc string cleanup.
    - OpenStack: Support setting mac address on bond. [Fabian Wiesel]
    - bash_completion/cloud-init: fix shell syntax error.
    - EphemeralIPv4Network: Be more explicit when adding default route.
    - OpenStack: support reading of newer versions of metdata.
    - OpenStack: fix bug causing 'latest' version to be used from network.
    - user-data: jinja template to render instance-data.json in cloud-config
    - config: disable ssh access to a configured user account
    - tests: print failed testname instead of docstring upon failure
    - tests: Disallow use of util.subp except for where needed.
    - sysconfig: refactor sysconfig to accept distro specific templates paths
    - Add unit tests for config/cc_ssh.py [Francis Ginther]
    - Fix the built-in cloudinit/tests/helpers:skipIf
    - read-version: enhance error message [Joshua Powers]
    - hyperv_reporting_handler: simplify threaded publisher
    - VMWare: Fix a network config bug in vm with static IPv4 and no gateway.
      [Pengpeng Sun]
    - logging: Add logging config type hyperv for reporting via Azure KVP
      [Andy Liu]
    - tests: disable other snap test as well [Joshua Powers]
    - tests: disable snap, fix write_files binary [Joshua Powers]
    - Add datasource Oracle Compute Infrastructure (OCI).
    - azure: allow azure to generate network configuration from IMDS per boot.
    - Scaleway: Add network configuration to the DataSource [Louis Bouchard]
    - docs: Fix example cloud-init analyze command to match output.
      [Wesley Gao]
    - netplan: Correctly render macaddress on a bonds and bridges when
      provided.
    - tools: Add 'net-convert' subcommand command to 'cloud-init devel'.
    - redhat: remove ssh keys on new i...

[Launchpad Janitor (janitor)]

This bug was fixed in the package cloud-init - 18.4-0ubuntu1~16.04.2

---------------
cloud-init (18.4-0ubuntu1~16.04.2) xenial; urgency=medium

  * cherry-pick 1d5e9aef: azure: Add apply_network_config option to
    disable network (LP: #1798424)
  * debian/patches/openstack-no-network-config.patch
    add patch to default Azure apply_network_config to False. Only
    fallback network config on eth0 is generated by cloud-init. IMDS
    network_config is ignored.

cloud-init (18.4-0ubuntu1~16.04.1) xenial-proposed; urgency=medium

  * drop the following cherry-picks now included:
    + cpick-3cee0bf8-oracle-fix-detect_openstack-to-report-True-on
  * refresh patches:
   + debian/patches/azure-use-walinux-agent.patch
   + debian/patches/openstack-no-network-config.patch
  * refresh patches:
   + debian/patches/ds-identify-behavior-xenial.patch
  * New upstream release. (LP: #1795953)
    - release 18.4
    - tests: allow skipping an entire cloud_test without running.
    - tests: disable lxd tests on cosmic
    - cii-tests: use unittest2.SkipTest in ntp_chrony due to new deps
    - lxd: adjust to snap installed lxd.
    - docs: surface experimental doc in instance-data.json
    - tests: fix ec2 integration tests. process meta_data instead of meta-data
    - Add support for Infiniband network interfaces (IPoIB). [Mark Goddard]
    - cli: add cloud-init query subcommand to query instance metadata
    - tools/tox-venv: update for new features.
    - pylint: ignore warning assignment-from-no-return for _write_network
    - stages: Fix bug causing datasource to have incorrect sys_cfg.
    - Remove dead-code _write_network distro implementations.
    - net_util: ensure static configs have netmask in translate_network result
      [Thomas Berger]
    - Fall back to root:root on syslog permissions if other options fail.
      [Robert Schweikert]
    - tests: Add mock for util.get_hostname. [Robert Schweikert]
    - ds-identify: doc string cleanup.
    - OpenStack: Support setting mac address on bond. [Fabian Wiesel]
    - bash_completion/cloud-init: fix shell syntax error.
    - EphemeralIPv4Network: Be more explicit when adding default route.
    - OpenStack: support reading of newer versions of metdata.
    - OpenStack: fix bug causing 'latest' version to be used from network.
    - user-data: jinja template to render instance-data.json in cloud-config
    - config: disable ssh access to a configured user account
    - tests: print failed testname instead of docstring upon failure
    - tests: Disallow use of util.subp except for where needed.
    - sysconfig: refactor sysconfig to accept distro specific templates paths
    - Add unit tests for config/cc_ssh.py [Francis Ginther]
    - Fix the built-in cloudinit/tests/helpers:skipIf
    - read-version: enhance error message [Joshua Powers]
    - hyperv_reporting_handler: simplify threaded publisher
    - VMWare: Fix a network config bug in vm with static IPv4 and no gateway.
      [Pengpeng Sun]
    - logging: Add logging config type hyperv for reporting via Azure KVP
      [Andy Liu]
    - tests: disable other snap test as well [Joshua Powers]
    - tests: disable snap, fix write_files binary [Joshua...