curtin install fails with Stdout: "[Errno 2] No such file or directory: '/tmp/tmp5NkcjO/state/config'\n"

[Samantha Jian-Pielak]

We are using MAAS 1.7.1 on Ubuntu 14.04 to provision a diskless server with access to iSCSI LUN and it fails with

[Errno 2] No such file or directory: '/tmp/tmp5NkcjO/state/config'
Installation failed with exception: Unexpected error while running command.
Command: ['curtin', 'block-meta', 'simple']
Exit code: 3
Reason: -
Stdout: "[Errno 2] No such file or directory: '/tmp/tmp5NkcjO/state/config'\n"
Stderr: ''

Complete install log: http://pastebin.ubuntu.com/10395275/

[Blake Rouse (blake-rouse)]

Very strange that config file should exists. Is this repeatable? Would it be possible for me to gain access to this machine?

[Srinivas (srinira)]

Yes, this is repeatable. we can work on accessing the machine, I can send you the details offline.

[Samantha Jian-Pielak (samantha-jian)]

still get the same error (http://pastebin.ubuntu.com/10610058/) after we added '/bin/echo -en "$NAME" >
/usr/share/initramfs-tools/modules.d/$NAME' to the postinst.

[Samantha Jian-Pielak (samantha-jian)]

After the system failed to be deployed by MAAS, we ssh in and collect the syslog and dmesg: http://paste.ubuntu.com/10623257/, http://paste.ubuntu.com/10623295/. It shows snic is installed and a SCSI drive is located and attached to the system.

ubuntu@elaborate-carpenter:~$ uname -a
Linux elaborate-carpenter 3.13.0-44-generic #73-Ubuntu SMP Tue Dec 16 00:22:43 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
ubuntu@elaborate-carpenter:~$

[Samantha Jian-Pielak (samantha-jian)]

MAAS version: $ sudo apt-cache policy maas
[sudo] password for srini:
maas:
  Installed: 1.7.2~rc2+bzr3353-0ubuntu1~trusty1
  Candidate: 1.7.2~rc2+bzr3353-0ubuntu1~trusty1
  Version table:
 *** 1.7.2~rc2+bzr3353-0ubuntu1~trusty1 0
        500 http://ppa.launchpad.net/maas-maintainers/testing/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status
     1.7.1+bzr3341-0ubuntu1~trusty1 0
        500 http://ppa.launchpad.net/maas-maintainers/stable/ubuntu/ trusty/main amd64 Packages
     1.5.4+bzr2294-0ubuntu1.3 0
        500 http://us.archive.ubuntu.com/ubuntu/ trusty-updates/main amd64 Packages
     1.5.4+bzr2294-0ubuntu1.2 0
        500 http://security.ubuntu.com/ubuntu/ trusty-security/main amd64 Packages
     1.5+bzr2252-0ubuntu1 0
        500 http://us.archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages

[Samantha Jian-Pielak (samantha-jian)]

the /tmp folder is cleared when DPKG is "Setting up snic-dkms (0.0.1.19) ...", that's before dkms sets up snic later.
http://pastebin.ubuntu.com/10675121/

[Samantha Jian-Pielak (samantha-jian)]

Using snic-dkms from either of the following PPA has the same result:
https://launchpad.net/~narindergupta/+archive/ubuntu/snic-test
Or
https://launchpad.net/~samantha-jian/+archive/ubuntu/snic-test3

drivers.yaml:

drivers:
- blacklist: ahci
  comment: SNIC driver DKMS
  key_binary: !!binary |
         mI0EUlhwQQEEAO1i44kj7Vx3Yf1K+R6BwBnVeirrIUj/02VttniA+sr5Qcgv1XNGSRTRl5kOqriu
         lb5SftQS9WbtVn6Tv8KdI6tWqulQsjtpifSmi0qh8oBZaWsKKtuV6HuWt1o8HpazXKKaD6Zbkibj
         n60LUCuRaXrtvoZMr1jNeW9EuNTlVbI/ABEBAAG0IExhdW5jaHBhZCBQUEEgZm9yIE5hcmluZGVy
         IEd1cHRhiLgEEwECACIFAlJYcEECGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJEE09VPJ7
         QIsXg5YD/2NjRPBbklAan5Lfj48g//MXHTq7NUs3gkn9p70cSIHRy5hjm/igsS2dPGSJW0+24eNq
         11vk5oo4/QSUj0UZL5Zd1+1UDqfxu+M9amW6dxYZ6HKFYWOniiw0rAg/C8poeb/Jp+q0USOo+LII
         5cXsteuqbqYNJIrb6RJQOZ7xM5M1
  modaliases:
  - 'pci:v00001137d00000046sv*sd*bc*sc*i*'
  module: snic
  package: snic-dkms
  repository: http://ppa.launchpad.net/narindergupta/snic-test/ubuntu

Or
drivers:
- blacklist: ahci
  comment: SNIC driver DKMS
  key_binary: !!binary |
         mI0EUOXengEEALfl4hqcwzKo+AKbtCnZqEK5wRAjNyrKXWe9EV6pfKLAJOdJnt5GQz7vHkd3ltH/
         aZxm3XWOvnrv0VBRD9W1q+8WOjxdS/HeZ3qVDma09fO+PYMiNnTRTOy11v82Bh1ul2XWsLTgG2sb
         05m/u2KB0bS3w/539PQnxETuOU2atscTABEBAAG0JkxhdW5jaHBhZCBQUEEgZm9yIFNhbWFudGhh
         IEppYW4tUGllbGFriLgEEwECACIFAlDl3p4CGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJ
         EHL06YYRzQvcDYAD/RDKw7HA+k/TINKHItBw1+Bn75khVTDb5yziV34qwzny64Ao/4JKn3VzariT
         1WFd8sx80A+5cuwerQUw+Ikhc0cbZNDWEhgv6kj4EADuqogjooqJwC6XP41tSYsKdasU7yB0BF5S
         UHgleAi/1qE3swqh16P8DoAHuVwFMAT4uAxo
  modaliases:
  - 'pci:v00001137d00000046sv*sd*bc*sc*i*'
  module: snic
  package: snic-dkms
  repository: http://ppa.launchpad.net/samantha-jian/snic-test3/ubuntu

[Samantha Jian-Pielak (samantha-jian)]

The root cause is very likely due to the update of the libc6: bug 1464442

[Andrew Cloke (andrew-cloke)]

Larry Michel has managed to track this bug down to the installation or upgrade of libc6 in Trusty. It would seem some packaging error in libc6 is wiping /tmp and causing this issue.

Larry has raised the following bug against libc6 for this issue: https://bugs.launchpad.net/ubuntu/+source/eglibc/+bug/1464442.