MAAS fails to deploy 16.04

[Scott Pendleton]

I am using MAAS 2.2.1. I have 6 nodes that were working in a conjure-up deployed Landscape environment. I had an issue where I decided it would be easier to clean the cluster and re-deploy an new stack. However I can't bootstrap becuase MAAS can't deploy 16.04. On all 6 nodes that were previously deployed with 16.04 I get a failed deployment. I can successfully deploy all 6 with 14.04. I was able to get one node into rescue mode and was able to get this from the cloud-init log

ubuntu@plabs-os-cn3:~$ cat /var/log/cloud-init-output.log
Cloud-init v. 0.7.9 running 'init-local' at Thu, 13 Jul 2017 01:53:51 +0000. Up 16.47 seconds.
Cloud-init v. 0.7.9 running 'init' at Thu, 13 Jul 2017 01:53:52 +0000. Up 17.64 seconds.
ci-info: ++++++++++++++++++++++++++++++++++++++++Net device info++++++++++++++++++++++++++++++++++++++++
ci-info: +----------+-------+------------------------------+---------------+-------+-------------------+
ci-info: | Device | Up | Address | Mask | Scope | Hw-Address |
ci-info: +----------+-------+------------------------------+---------------+-------+-------------------+
ci-info: | enp3s0f0 | True | 10.1.1.48 | 255.255.255.0 | . | 78:e3:b5:0d:ce:0c |
ci-info: | enp3s0f0 | True | fe80::7ae3:b5ff:fe0d:ce0c/64 | . | link | 78:e3:b5:0d:ce:0c |
ci-info: | enp4s0f0 | False | . | . | . | 78:e3:b5:0d:ce:08 |
ci-info: | lo | True | 127.0.0.1 | 255.0.0.0 | . | . |
ci-info: | lo | True | ::1/128 | . | host | . |
ci-info: | enp4s0f1 | False | . | . | . | 78:e3:b5:0d:ce:0a |
ci-info: | enp3s0f1 | False | . | . | . | 78:e3:b5:0d:ce:0e |
ci-info: +----------+-------+------------------------------+---------------+-------+-------------------+
ci-info: ++++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++
ci-info: +-------+-------------+-----------+---------------+-----------+-------+
ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags |
ci-info: +-------+-------------+-----------+---------------+-----------+-------+
ci-info: | 0 | 0.0.0.0 | 10.1.1.10 | 0.0.0.0 | enp3s0f0 | UG |
ci-info: | 1 | 10.1.1.0 | 0.0.0.0 | 255.255.255.0 | enp3s0f0 | U |
ci-info: +-------+-------------+-----------+---------------+-----------+-------+
2017-07-13 01:53:55,594 - cc_resizefs.py[WARNING]: Device 'overlayroot' did not exist. cannot resize: dev=overlayroot mnt_point=/ path=/
Generating public/private rsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_rsa_key.
Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.
The key fingerprint is:
SHA256:h1xPg5IanOC4YiHzrGp48+847ySTB19zqDodS7XvIG0 root@plabs-os-cn3
The key's randomart image is:
+---[RSA 2048]----+
| . |
| o o . . . |
|o.. . + o o o |
|.+.. +.= o . |
|..+ . ..S.o . |
|.o +o+.+ |
|o +o*oE. |
|o.o oBoo .. |
|o. o+B= .. |
+----[SHA256]-----+
Generating public/private dsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_dsa_key.
Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.
The key fingerprint is:
SHA256:5NgoJzwCOVyp+TVWWgbQIJzERUBU+1FYQ+QngBNvlLY root@plabs-os-cn3
The key's randomart image is:
+---[DSA 1024]----+
|***OB+B* |
|.=o++=++. |
|+.o.o+*o.. |
| = .oE.*o |
| o B.= S |
| o = |
| |
| |
| |
+----[SHA256]-----+
Generating public/private ecdsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key.
Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub.
The key fingerprint is:
SHA256:pg5VLP03VxEm/NiRah9TDnuZQU3qD+dTIly8G/gIpU8 root@plabs-os-cn3
The key's randomart image is:
+---[ECDSA 256]---+
| ...*=|
| o o+=+|
| . + . O+B|
| o . + B.Xo|
| . S + E O.=|
| . o = * X.|
| . . o o.o|
| o .|
| . |
+----[SHA256]-----+
Generating public/private ed25519 key pair.
Your identification has been saved in /etc/ssh/ssh_host_ed25519_key.
Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub.
The key fingerprint is:
SHA256:DyTsFS+n8VHK8iO79G4O2pResSjtIeiqycYDC/rm1B0 root@plabs-os-cn3
The key's randomart image is:
+--[ED25519 256]--+
| . . |
| . + o |
| o * * |
| . + O . |
| E S = |
|o . o o B + |
|=.. o + X + |
|+*.. X *. |
|+*=.. . =++ |
+----[SHA256]-----+
Generating locales (this might take a while)...
  en_US.UTF-8... done
Generation complete.
Hit:1 http://archive.ubuntu.com/ubuntu xenial InRelease
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Get:4 http://archive.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Get:5 http://archive.ubuntu.com/ubuntu xenial/main Sources [868 kB]
Get:6 http://archive.ubuntu.com/ubuntu xenial/restricted Sources [4808 B]
Get:7 http://archive.ubuntu.com/ubuntu xenial/universe Sources [7728 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial/multiverse Sources [179 kB]
Get:9 http://archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [7532 kB]
Get:10 http://archive.ubuntu.com/ubuntu xenial/universe Translation-en [4354 kB]
Get:11 http://archive.ubuntu.com/ubuntu xenial/multiverse amd64 Packages [144 kB]
Get:12 http://archive.ubuntu.com/ubuntu xenial/multiverse Translation-en [106 kB]
Get:13 http://archive.ubuntu.com/ubuntu xenial-updates/main Sources [258 kB]
Get:14 http://archive.ubuntu.com/ubuntu xenial-updates/restricted Sources [3000 B]
Get:15 http://archive.ubuntu.com/ubuntu xenial-updates/universe Sources [164 kB]
Get:16 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse Sources [5668 B]
Get:17 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [573 kB]
Get:18 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [504 kB]
Get:19 http://archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [196 kB]
Get:20 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 Packages [8928 B]
Get:21 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse Translation-en [4460 B]
Get:22 http://archive.ubuntu.com/ubuntu xenial-backports/main Sources [3312 B]
Get:23 http://archive.ubuntu.com/ubuntu xenial-backports/universe Sources [4384 B]
Get:24 http://archive.ubuntu.com/ubuntu xenial-backports/main amd64 Packages [4680 B]
Get:25 http://archive.ubuntu.com/ubuntu xenial-backports/main Translation-en [3216 B]
Get:26 http://archive.ubuntu.com/ubuntu xenial-backports/universe amd64 Packages [5804 B]
Get:27 http://archive.ubuntu.com/ubuntu xenial-backports/universe Translation-en [3004 B]
Get:28 http://archive.ubuntu.com/ubuntu xenial-security/main Sources [78.4 kB]
Get:29 http://archive.ubuntu.com/ubuntu xenial-security/restricted Sources [2604 B]
Get:30 http://archive.ubuntu.com/ubuntu xenial-security/universe Sources [36.2 kB]
Get:31 http://archive.ubuntu.com/ubuntu xenial-security/multiverse Sources [1144 B]
Get:32 http://archive.ubuntu.com/ubuntu xenial-security/main amd64 Packages [300 kB]
Get:33 http://archive.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [143 kB]
Get:34 http://archive.ubuntu.com/ubuntu xenial-security/universe Translation-en [74.0 kB]
Get:35 http://archive.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [2748 B]
Get:36 http://archive.ubuntu.com/ubuntu xenial-security/multiverse Translation-en [1232 B]
Fetched 23.6 MB in 7s (3033 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libopts25
Suggested packages:
  ntp-doc
The following NEW packages will be installed:
  libopts25 ntp
0 upgraded, 2 newly installed, 0 to remove and 1 not upgraded.
Need to get 578 kB of archives.
After this operation, 1792 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 libopts25 amd64 1:5.18.7-3 [57.8 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 ntp amd64 1:4.2.8p4+dfsg-3ubuntu5.5 [520 kB]
Fetched 578 kB in 0s (47.3 MB/s)
Selecting previously unselected package libopts25:amd64.
(Reading database ... 25503 files and directories currently installed.)
Preparing to unpack .../libopts25_1%3a5.18.7-3_amd64.deb ...
Unpacking libopts25:amd64 (1:5.18.7-3) ...
Selecting previously unselected package ntp.
Preparing to unpack .../ntp_1%3a4.2.8p4+dfsg-3ubuntu5.5_amd64.deb ...
Unpacking ntp (1:4.2.8p4+dfsg-3ubuntu5.5) ...
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for systemd (229-4ubuntu17) ...
Processing triggers for ureadahead (0.100.0-19) ...
Setting up libopts25:amd64 (1:5.18.7-3) ...
Setting up ntp (1:4.2.8p4+dfsg-3ubuntu5.5) ...

Configuration file '/etc/ntp.conf'
 ==> File on system created by you or by a script.
 ==> File also in package provided by package maintainer.
 ==> Using current old file as you requested.
ERROR: ld.so: object 'libeatmydata.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
Processing triggers for libc-bin (2.23-0ubuntu9) ...
Processing triggers for systemd (229-4ubuntu17) ...
Processing triggers for ureadahead (0.100.0-19) ...
Cloud-init v. 0.7.9 running 'modules:config' at Thu, 13 Jul 2017 01:53:59 +0000. Up 23.85 seconds.
Success
Cloud-init v. 0.7.9 running 'modules:final' at Thu, 13 Jul 2017 01:54:23 +0000. Up 48.53 seconds.
2017-07-13 01:54:26,910 - util.py[WARNING]: Failed running /var/lib/cloud/instance/scripts/user_data.sh [1]
2017-07-13 01:54:26,914 - cc_scripts_user.py[WARNING]: Failed to run module scripts-user (scripts in /var/lib/cloud/instance/scripts)
2017-07-13 01:54:26,998 - util.py[WARNING]: Running module scripts-user (<module 'cloudinit.config.cc_scripts_user' from '/usr/lib/python3/dist-packages/cloudinit/config/cc_scripts_user.py'>) failed
Cloud-init v. 0.7.9 finished at Thu, 13 Jul 2017 01:54:27 +0000. Datasource DataSourceMAAS [http://10.1.1.10:5240/MAAS/metadata/]. Up 52.46 seconds
=============================================================================================

Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-===============================-==============================-============-=================================================
ii maas 2.1.5+bzr5596-0ubuntu1~16.04.1 all "Metal as a Service" is a physical cloud and IPAM
ii maas-cli 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS client and command-line interface
un maas-cluster-controller <none> <none> (no description available)
ii maas-common 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS server common files
ii maas-dhcp 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS DHCP server
ii maas-dns 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS DNS server
ii maas-proxy 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS Caching Proxy
ii maas-rack-controller 2.1.5+bzr5596-0ubuntu1~16.04.1 all Rack Controller for MAAS
ii maas-region-api 2.1.5+bzr5596-0ubuntu1~16.04.1 all Region controller API service for MAAS
ii maas-region-controller 2.1.5+bzr5596-0ubuntu1~16.04.1 all Region Controller for MAAS
un maas-region-controller-min <none> <none> (no description available)
un python-django-maas <none> <none> (no description available)
un python-maas-client <none> <none> (no description available)
un python-maas-provisioningserver <none> <none> (no description available)
ii python3-django-maas 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS server Django web framework (Python 3)
ii python3-maas-client 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS python API client (Python 3)
ii python3-maas-provisioningserver 2.1.5+bzr5596-0ubuntu1~16.04.1 all MAAS server provisioning libraries (Python 3)

=============================================================================================

[Andres Rodriguez (andreserl)]

Hi Scott,

You are using MAAS 2.1.5 and you are being affected by [1]. 2.1 is now deprecated upstream and will soon be replaced by MAAS 2.2, which is currently in -proposed for Xenial (or the latest point release in ppa:maas/stable).

While I highly encourage you to upgrade, you can work around the problem with the suggestions in [2].

Hope this helps

[1]: https://bugs.launchpad.net/cloud-init/+bug/1701297
[2]: https://bugs.launchpad.net/cloud-init/+bug/1701297/comments/32