Activity log for bug #1619459

Date Who What changed Old value New value Message
2016-09-01 20:40:19 Scott Moser bug added bug
2016-09-01 20:40:26 Scott Moser cloud-initramfs-tools (Ubuntu): status New Confirmed
2016-09-01 20:40:30 Scott Moser cloud-initramfs-tools (Ubuntu): importance Undecided Medium
2016-09-02 17:00:37 Launchpad Janitor cloud-initramfs-tools (Ubuntu): status Confirmed Fix Released
2016-11-29 01:40:16 Scott Moser nominated for series Ubuntu Xenial
2016-11-29 01:40:16 Scott Moser bug task added cloud-initramfs-tools (Ubuntu Xenial)
2016-11-29 01:40:24 Scott Moser cloud-initramfs-tools (Ubuntu Xenial): status New Fix Committed
2016-11-29 01:40:27 Scott Moser cloud-initramfs-tools (Ubuntu Xenial): importance Undecided Medium
2016-11-29 01:40:29 Scott Moser cloud-initramfs-tools (Ubuntu Xenial): assignee Scott Moser (smoser)
2016-11-29 01:40:33 Scott Moser cloud-initramfs-tools (Ubuntu Xenial): status Fix Committed In Progress
2016-11-29 22:18:06 Scott Moser description to reproduce, boot a yakkety disk1.img. this is a uefi image, so it has multiple partitions. sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' you'll see it hang. the reason i believe is the info written to /etc/fstab for the non-root mounts does not include workdir information. === Begin SRU Template === [Impact] The impact on xenial would only be seen if there were multiple filesystems mounted. In the 16.04 cloud image that is used on openstack or many other clouds, there is only one partition. But in the 16.10 image there is a separate uefi partition that caused havoc to overlayroot as the 'workdir' option was not correctly supported. [Test Case] The following should work, but currently does not. Note, to test the fix, between step 1 and 2, you'll need to enable proposed and install overlayroot. 1. Start an instance of a cloud image with 2 disks. On openstack by default you get 2 disks (an ephemeral and a root). Cloud-init will configure the ephemeral to be a /mnt. 2. remove cloud-init's configuration of /etc/fstab options These can cause issue with the way overlayroot does its mounts. So just remove the special options that cloud-init writes. $ sed -i.dist s/x-systemd.requires=cloud-init.service,comment=cloudconfig// /etc/fstab if you do not do that, then /mnt will not get mounted, and journalctl will show a ordering cycle on the mount. The following will show failed. systemctl status 'media-root\x2dro-mnt.mount' Note, this is a separate bug, mentioned here only for completeness. 3. Enable proposed and install overlayroot to show fix. $ rel=$(lsb_release -sc) $ echo "deb http://archive.ubuntu.com/ubuntu $rel-proposed main" | $ sudo tee /etc/apt/sources.list.d/proposed.list $ sudo apt update -qy && sudo apt install -qy overlayroot </dev/null $ dpkg-query --show overlayroot overlayroot 0.27ubuntu1.3 4. configure overlayroot to use tmpfs with recurse=1 and reboot. $ echo "overlayroot=tmpfs:recurse=1" | sudo tee /etc/overlayroot.local.conf $ sudo reboot 4. log back in and look around a.) check that 'overlay' is in /proc/mounts for / and /mnt $ awk '$3 ~ /overlay/ { print $0 }' /proc/mounts overlayroot / overlay rw,relatime,lowerdir=/media/root-ro,upperdir=/media/root-rw/overlay,workdir=/media/root-rw/overlay-workdir/_ 0 0 /media/root-ro/mnt /mnt overlay rw,relatime,lowerdir=/media/root-ro/mnt,upperdir=/media/root-rw/overlay/mnt,workdir=/media/root-rw/overlay-workdir/mnt 0 0 b.) check that /mnt is set as overlay $ df -h /mnt Filesystem Size Used Avail Use% Mounted on /media/root-ro/mnt 1000M 1.3M 999M 1% /mnt c.) check /run/initramfs/overlayroot.log $ grep success /run/initramfs/overlayroot.log [success]: configured root with 'tmpfs:recurse=1' using overlay per /dev/vda1/etc/overlayroot.local.conf [Regression Potential] Previously almost any scenario with multiple mount points would cause failure to boot. This change does improve the situation, and is not likely to regress it. [Other Info] === End SRU Template === to reproduce, boot a yakkety disk1.img. this is a uefi image, so it has multiple partitions. sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' you'll see it hang. the reason i believe is the info written to /etc/fstab for the non-root mounts does not include workdir information.
2016-11-29 22:18:28 Scott Moser description === Begin SRU Template === [Impact] The impact on xenial would only be seen if there were multiple filesystems mounted. In the 16.04 cloud image that is used on openstack or many other clouds, there is only one partition. But in the 16.10 image there is a separate uefi partition that caused havoc to overlayroot as the 'workdir' option was not correctly supported. [Test Case] The following should work, but currently does not. Note, to test the fix, between step 1 and 2, you'll need to enable proposed and install overlayroot. 1. Start an instance of a cloud image with 2 disks. On openstack by default you get 2 disks (an ephemeral and a root). Cloud-init will configure the ephemeral to be a /mnt. 2. remove cloud-init's configuration of /etc/fstab options These can cause issue with the way overlayroot does its mounts. So just remove the special options that cloud-init writes. $ sed -i.dist s/x-systemd.requires=cloud-init.service,comment=cloudconfig// /etc/fstab if you do not do that, then /mnt will not get mounted, and journalctl will show a ordering cycle on the mount. The following will show failed. systemctl status 'media-root\x2dro-mnt.mount' Note, this is a separate bug, mentioned here only for completeness. 3. Enable proposed and install overlayroot to show fix. $ rel=$(lsb_release -sc) $ echo "deb http://archive.ubuntu.com/ubuntu $rel-proposed main" | $ sudo tee /etc/apt/sources.list.d/proposed.list $ sudo apt update -qy && sudo apt install -qy overlayroot </dev/null $ dpkg-query --show overlayroot overlayroot 0.27ubuntu1.3 4. configure overlayroot to use tmpfs with recurse=1 and reboot. $ echo "overlayroot=tmpfs:recurse=1" | sudo tee /etc/overlayroot.local.conf $ sudo reboot 4. log back in and look around a.) check that 'overlay' is in /proc/mounts for / and /mnt $ awk '$3 ~ /overlay/ { print $0 }' /proc/mounts overlayroot / overlay rw,relatime,lowerdir=/media/root-ro,upperdir=/media/root-rw/overlay,workdir=/media/root-rw/overlay-workdir/_ 0 0 /media/root-ro/mnt /mnt overlay rw,relatime,lowerdir=/media/root-ro/mnt,upperdir=/media/root-rw/overlay/mnt,workdir=/media/root-rw/overlay-workdir/mnt 0 0 b.) check that /mnt is set as overlay $ df -h /mnt Filesystem Size Used Avail Use% Mounted on /media/root-ro/mnt 1000M 1.3M 999M 1% /mnt c.) check /run/initramfs/overlayroot.log $ grep success /run/initramfs/overlayroot.log [success]: configured root with 'tmpfs:recurse=1' using overlay per /dev/vda1/etc/overlayroot.local.conf [Regression Potential] Previously almost any scenario with multiple mount points would cause failure to boot. This change does improve the situation, and is not likely to regress it. [Other Info] === End SRU Template === to reproduce, boot a yakkety disk1.img. this is a uefi image, so it has multiple partitions. sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' you'll see it hang. the reason i believe is the info written to /etc/fstab for the non-root mounts does not include workdir information. === Begin SRU Template === [Impact] The impact on xenial would only be seen if there were multiple filesystems mounted. In the 16.04 cloud image that is used on openstack or many other clouds, there is only one partition. But in the 16.10 image there is a separate uefi partition that caused havoc to overlayroot as the 'workdir' option was not correctly supported. [Test Case] The following should work, but currently does not. Note, to test the fix, between step 1 and 2, you'll need to enable proposed and install overlayroot. 1. Start an instance of a cloud image with 2 disks.    On openstack by default you get 2 disks (an ephemeral and a root).    Cloud-init will configure the ephemeral to be a /mnt. 2. remove cloud-init's configuration of /etc/fstab options     These can cause issue with the way overlayroot does its mounts.     So just remove the special options that cloud-init writes.     $ sed -i.dist s/x-systemd.requires=cloud-init.service,comment=cloudconfig// /etc/fstab     if you do not do that, then /mnt will not get mounted, and journalctl     will show a ordering cycle on the mount. The following will show failed.        systemctl status 'media-root\x2dro-mnt.mount'     Note, this is a separate bug, mentioned here only for completeness. 3. Enable proposed and install overlayroot to show fix.     $ rel=$(lsb_release -sc)     $ echo "deb http://archive.ubuntu.com/ubuntu $rel-proposed main" |     $ sudo tee /etc/apt/sources.list.d/proposed.list     $ sudo apt update -qy && sudo apt install -qy overlayroot </dev/null     $ dpkg-query --show overlayroot     overlayroot 0.27ubuntu1.3 4. configure overlayroot to use tmpfs with recurse=1 and reboot.    $ echo "overlayroot=tmpfs:recurse=1" | sudo tee /etc/overlayroot.local.conf    $ sudo reboot 4. log back in and look around    a.) check that 'overlay' is in /proc/mounts for / and /mnt        $ awk '$3 ~ /overlay/ { print $0 }' /proc/mounts        overlayroot / overlay rw,relatime,lowerdir=/media/root-ro,upperdir=/media/root-rw/overlay,workdir=/media/root-rw/overlay-workdir/_ 0 0        /media/root-ro/mnt /mnt overlay rw,relatime,lowerdir=/media/root-ro/mnt,upperdir=/media/root-rw/overlay/mnt,workdir=/media/root-rw/overlay-workdir/mnt 0 0    b.) check that /mnt is set as overlay        $ df -h /mnt        Filesystem Size Used Avail Use% Mounted on        /media/root-ro/mnt 1000M 1.3M 999M 1% /mnt    c.) check /run/initramfs/overlayroot.log        $ grep success /run/initramfs/overlayroot.log        [success]: configured root with 'tmpfs:recurse=1' using overlay per /dev/vda1/etc/overlayroot.local.conf [Regression Potential] Previously almost any scenario with multiple mount points would cause failure to boot. This change does improve the situation, and is not likely to regress it. [Other Info] === End SRU Template === to reproduce, boot a yakkety disk1.img. this is a uefi image, so it has multiple partitions. sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' you'll see it hang. the reason i believe is the info written to /etc/fstab for the non-root mounts does not include workdir information.
2016-11-29 23:12:55 Chris Halse Rogers cloud-initramfs-tools (Ubuntu Xenial): status In Progress Fix Committed
2016-11-29 23:12:56 Chris Halse Rogers bug added subscriber Ubuntu Stable Release Updates Team
2016-11-29 23:12:58 Chris Halse Rogers bug added subscriber SRU Verification
2016-11-29 23:13:04 Chris Halse Rogers tags verification-needed
2016-12-02 14:45:13 Scott Moser description === Begin SRU Template === [Impact] The impact on xenial would only be seen if there were multiple filesystems mounted. In the 16.04 cloud image that is used on openstack or many other clouds, there is only one partition. But in the 16.10 image there is a separate uefi partition that caused havoc to overlayroot as the 'workdir' option was not correctly supported. [Test Case] The following should work, but currently does not. Note, to test the fix, between step 1 and 2, you'll need to enable proposed and install overlayroot. 1. Start an instance of a cloud image with 2 disks.    On openstack by default you get 2 disks (an ephemeral and a root).    Cloud-init will configure the ephemeral to be a /mnt. 2. remove cloud-init's configuration of /etc/fstab options     These can cause issue with the way overlayroot does its mounts.     So just remove the special options that cloud-init writes.     $ sed -i.dist s/x-systemd.requires=cloud-init.service,comment=cloudconfig// /etc/fstab     if you do not do that, then /mnt will not get mounted, and journalctl     will show a ordering cycle on the mount. The following will show failed.        systemctl status 'media-root\x2dro-mnt.mount'     Note, this is a separate bug, mentioned here only for completeness. 3. Enable proposed and install overlayroot to show fix.     $ rel=$(lsb_release -sc)     $ echo "deb http://archive.ubuntu.com/ubuntu $rel-proposed main" |     $ sudo tee /etc/apt/sources.list.d/proposed.list     $ sudo apt update -qy && sudo apt install -qy overlayroot </dev/null     $ dpkg-query --show overlayroot     overlayroot 0.27ubuntu1.3 4. configure overlayroot to use tmpfs with recurse=1 and reboot.    $ echo "overlayroot=tmpfs:recurse=1" | sudo tee /etc/overlayroot.local.conf    $ sudo reboot 4. log back in and look around    a.) check that 'overlay' is in /proc/mounts for / and /mnt        $ awk '$3 ~ /overlay/ { print $0 }' /proc/mounts        overlayroot / overlay rw,relatime,lowerdir=/media/root-ro,upperdir=/media/root-rw/overlay,workdir=/media/root-rw/overlay-workdir/_ 0 0        /media/root-ro/mnt /mnt overlay rw,relatime,lowerdir=/media/root-ro/mnt,upperdir=/media/root-rw/overlay/mnt,workdir=/media/root-rw/overlay-workdir/mnt 0 0    b.) check that /mnt is set as overlay        $ df -h /mnt        Filesystem Size Used Avail Use% Mounted on        /media/root-ro/mnt 1000M 1.3M 999M 1% /mnt    c.) check /run/initramfs/overlayroot.log        $ grep success /run/initramfs/overlayroot.log        [success]: configured root with 'tmpfs:recurse=1' using overlay per /dev/vda1/etc/overlayroot.local.conf [Regression Potential] Previously almost any scenario with multiple mount points would cause failure to boot. This change does improve the situation, and is not likely to regress it. [Other Info] === End SRU Template === to reproduce, boot a yakkety disk1.img. this is a uefi image, so it has multiple partitions. sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' you'll see it hang. the reason i believe is the info written to /etc/fstab for the non-root mounts does not include workdir information. === Begin SRU Template === [Impact] The impact on xenial would only be seen if there were multiple filesystems mounted. In the 16.04 cloud image that is used on openstack or many other clouds, there is only one partition. But in the 16.10 image there is a separate uefi partition that caused havoc to overlayroot as the 'workdir' option was not correctly supported. [Test Case] The following should work, but currently does not. Note, to test the fix, between step 1 and 2, you'll need to enable proposed and install overlayroot. 1. Start an instance of a cloud image with 2 disks.    On openstack by default you get 2 disks (an ephemeral and a root).    Cloud-init will configure the ephemeral to be a /mnt. 2. remove cloud-init's configuration of /etc/fstab options     These can cause issue with the way overlayroot does its mounts.     So just remove the special options that cloud-init writes.     $ sed -i.dist s/,x-systemd.requires=cloud-init.service,comment=cloudconfig// /etc/fstab     if you do not do that, then /mnt will not get mounted, and journalctl     will show a ordering cycle on the mount. The following will show failed.        systemctl status 'media-root\x2dro-mnt.mount'     Note, this is a separate bug, mentioned here only for completeness. 3. Enable proposed and install overlayroot to show fix.     $ rel=$(lsb_release -sc)     $ echo "deb http://archive.ubuntu.com/ubuntu $rel-proposed main" |     $ sudo tee /etc/apt/sources.list.d/proposed.list     $ sudo apt update -qy && sudo apt install -qy overlayroot </dev/null     $ dpkg-query --show overlayroot     overlayroot 0.27ubuntu1.3 4. configure overlayroot to use tmpfs with recurse=1 and reboot.    $ echo "overlayroot=tmpfs:recurse=1" | sudo tee /etc/overlayroot.local.conf    $ sudo reboot 4. log back in and look around    a.) check that 'overlay' is in /proc/mounts for / and /mnt        $ awk '$3 ~ /overlay/ { print $0 }' /proc/mounts        overlayroot / overlay rw,relatime,lowerdir=/media/root-ro,upperdir=/media/root-rw/overlay,workdir=/media/root-rw/overlay-workdir/_ 0 0        /media/root-ro/mnt /mnt overlay rw,relatime,lowerdir=/media/root-ro/mnt,upperdir=/media/root-rw/overlay/mnt,workdir=/media/root-rw/overlay-workdir/mnt 0 0    b.) check that /mnt is set as overlay        $ df -h /mnt        Filesystem Size Used Avail Use% Mounted on        /media/root-ro/mnt 1000M 1.3M 999M 1% /mnt    c.) check /run/initramfs/overlayroot.log        $ grep success /run/initramfs/overlayroot.log        [success]: configured root with 'tmpfs:recurse=1' using overlay per /dev/vda1/etc/overlayroot.local.conf [Regression Potential] Previously almost any scenario with multiple mount points would cause failure to boot. This change does improve the situation, and is not likely to regress it. [Other Info] === End SRU Template === to reproduce, boot a yakkety disk1.img. this is a uefi image, so it has multiple partitions. sudo sh -c 'echo overlayroot=tmpfs > /etc/overlayroot.local.conf && reboot' you'll see it hang. the reason i believe is the info written to /etc/fstab for the non-root mounts does not include workdir information.
2016-12-02 14:45:23 Scott Moser tags verification-needed verification-done
2016-12-19 16:28:07 Launchpad Janitor cloud-initramfs-tools (Ubuntu Xenial): status Fix Committed Fix Released
2016-12-19 16:28:27 Robie Basak removed subscriber Ubuntu Stable Release Updates Team