[SRU] move walinuxagent init functionality to cloud-init

[Scott Moser]

[PACKAGES] cloud-init and walinuxagent

[Bundled SRU]: This SRU is 'bundled' for both cloud-init and walinuxagent. In order for either WALinuxAgent or Cloud-init to provide the new functionality, both have to land in the archive around the same time, with cloud-init landing _before_ WALinuxAgent. For this reason, this SRU covers both cloud-init and WALinuxAgent

[Impact]: On Windows Azure for 12.04, boot time provisioning is handled by WALinuxAgent. However, WALinuxAgent is incapable of handling user-data, which is a Juju requirement. Further, while WALinuxAgent is capable of providing boot time provisioning, it configures the system in a non-Debian way, which makes Azure images inconsitent with other Clouds. In order to provide a consistent and reliable cloud experience, Cloud-init with Azure support is needed.

[Impact: Cloud-init]: This change introduces code for the Windows Azure datasource.

[Impact: WALinuxAgent]: The default configuration for WALinuxAgent is now set to disable boot time provisioning, and only functions as a fabric checkin. By moving provisioning functions from WALinuxAgent to Cloud-init, cloud images are now portable between EC2, OpenStack and Windows Azure. This also reduces the support burden by using cloud-init to provision Windows Azure cloud images.

[Regression: Cloud-init]: The regression potential is low, as this is an introduction of new functionality. The new functionality is provided via a new datasource, which is currently not configured for cloud images; only when the new functionality is enabled, will the datasource run. The addition of the Windows Azure datasource will not affect other datasources.

[Regression: WALinuxAgent]: By default, WALinuxAgent now requires cloud-init. The default configuration is now set to ignore boot-time provisioning. On systems that have WALinuxAgent installed, the current configuration is used. This means that WALinuxAgent will continue to work as before, unless the user takes specific action to enable cloud-init.

Description of the problem :

[ORIGINAL REPORT]
As much as possible, I would like to move the initialization code that walinux agent does into cloud-init.
cloud-init could detect the fact that it is on azure (or be configured to look there).

The thing we need here is user-data support in cloud-init in one way or another.

[Ben Howard (darkmuggle-deactivatedaccount)]

The work has been done for Saucy, and is currently in progress for Precise. Saucy is currently working with provisioning by Cloud-Init.

[Scott Moser (smoser)]

fixed in cloud-init in saucy at 0.7.3~bzr829-0ubuntu1
fixed in walinuxagent in saucy at 1.3.2-0ubuntu3.

There is a ppa of precise builds at https://launchpad.net/~azure-cloud-builds/+archive/sru
  apt-add-repository -y ppa:azure-cloud-builds/sru

[Ben Howard (darkmuggle-deactivatedaccount)]

PPA testing against the latest version works perfectly for 12.04.2. In testing, cloud-init provisioned images boot faster and are available before the Windows Azure fabric reports them ready.

IMO, this is ready for SRU'ing.

[Adam Conrad (adconrad)]

Adding Q/R tasks to this, as leaving users with a potentially broken upgrade path is probably a bad plan.

[Adam Conrad (adconrad)]

Hello Scott, or anyone else affected,

Accepted walinuxagent into precise-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/walinuxagent/1.3.2-0ubuntu4~12.04.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Adam Conrad (adconrad)]

Hello Scott, or anyone else affected,

Accepted walinuxagent into precise-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/walinuxagent/1.3.2-0ubuntu4~12.04.3 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Adam Conrad (adconrad)]

Hello Scott, or anyone else affected,

Accepted walinuxagent into precise-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/walinuxagent/1.3.2-0ubuntu4~12.04.4 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Ben Howard (darkmuggle-deactivatedaccount)]

Confirmed that this is resolved with -proposed packages.

I launched a new instance built from the -proposed packages and instance provisioned properly. Also did an upgrade test on an existing instance and confirmed that the upgrade did not switch provisioning method.

Marking verification-done.

[Launchpad Janitor (janitor)]

This bug was fixed in the package walinuxagent - 1.3.2-0ubuntu4~12.04.4

---------------
walinuxagent (1.3.2-0ubuntu4~12.04.4) precise; urgency=low

  * Update versioned cloud-init dependency for the precise version.

walinuxagent (1.3.2-0ubuntu4~12.04.3) precise; urgency=low

  * Backport of 13.10 WALinuxAgent to support Cloud-init provisioning,
    and various bug fixes.
    * debian/patches/shadow_permissions.patch: apply the appropriate
      permissions to /etc/shadow (LP: #1188820).
    * debian/patches/verbose_logging.patch: use the appropriate log
      faculty when using verbose logging (LP: #1193404).
    * Mark bugs fixed in 1.3.2-0ubuntu3:
      debian/patches/config_for_cloud-init.patch:
      - fix for race condition between cloud-init and waagent (LP: #1195524)
      - mount resource disk on /mnt (LP: #1193380)
      - move walinuxagent init functionality to cloud-init (LP: #1037723)
    * debian/patches/config_for_cloud-init.patch:
      Modified configuration to disable provisioning functions.
      walinuxagent for Ubuntu should now be used with Cloud-init.
    * debian/postinst: Don't overwrite existing /etc/waagent.conf agent
      configuration on install or upgrade.
    * debian/upstart: start later in boot, avoiding race conditions
      with cloud-init.
    * Added logic to prevent udev rules.d movement (LP: #1188753)
 -- Adam Conrad <email address hidden> Thu, 15 Aug 2013 21:31:01 -0600

[Ben Howard (darkmuggle-deactivatedaccount)]

Marking cloud-init fixed-released.

[Ben Howard (darkmuggle-deactivatedaccount)]

Bug #1233315 and Bug #1231490 bring 12.10 and 13.04 funcationality with it.

[Stéphane Graber (stgraber)]

Hello Scott, or anyone else affected,

Accepted walinuxagent into raring-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/walinuxagent/1.3.2-0ubuntu2~13.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Launchpad Janitor (janitor)]

This bug was fixed in the package walinuxagent - 1.3.2-0ubuntu2~13.04.1

---------------
walinuxagent (1.3.2-0ubuntu2~13.04.1) raring-proposed; urgency=low

  * Backport of 1.3.2-0ubuntu5 from 13.10
    * disable ephemeral disk formating by default (LP: #1231490)
    * debian/patches/shadow_permissions.patch: apply the appropriate
      permissions to /etc/shadow (LP: #1188820).
    * debian/patches/verbose_logging.patch: use the appropriate log
      faculty when using verbose logging (LP: #1193404).
    * Mark bugs fixed in 1.3.2-0ubuntu3:
      debian/patches/config_for_cloud-init.patch:
      - fix for race condition between cloud-init and waagent (LP: #1195524)
      - mount resource disk on /mnt (LP: #1193380)
      - move walinuxagent init functionality to cloud-init (LP: #1037723)
  * Add requirement of cloud-init (LP: #1037723).
 -- Ben Howard <email address hidden> Thu, 10 Oct 2013 09:24:46 -0600

[Rolf Leggewie (r0lf)]

raring has seen the end of its life and is no longer receiving any updates. Marking the raring task for this ticket as "Won't Fix".