| 2020-05-01 16:05:35 |
Chris Newcomer |
bug |
|
|
added bug |
| 2020-05-01 16:05:35 |
Chris Newcomer |
attachment added |
|
term.log.1 https://bugs.launchpad.net/bugs/1876334/+attachment/5364533/+files/term.log.1 |
|
| 2020-05-01 16:10:13 |
Chris Newcomer |
attachment added |
|
Sosreport from laptop with same symptom https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1876334/+attachment/5364535/+files/sosreport-neuromancer-2020-05-01-mejivuj.tar.xz |
|
| 2020-05-01 16:13:53 |
Chris Newcomer |
attachment added |
|
zfs_list_-t_snap_-r_rpool https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1876334/+attachment/5364536/+files/zfs_list_-t_snap_-r_rpool |
|
| 2020-05-01 16:14:05 |
Chris Newcomer |
attachment added |
|
zfs_list_-t_snap_-r_bpool https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1876334/+attachment/5364537/+files/zfs_list_-t_snap_-r_bpool |
|
| 2020-05-01 16:15:43 |
Chris Newcomer |
attachment added |
|
zfs_list_-o_space_-r_bpool https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1876334/+attachment/5364538/+files/zfs_list_-o_space_-r_bpool |
|
| 2020-05-02 06:51:34 |
Jean-Baptiste Lallement |
zsys (Ubuntu): importance |
Undecided |
High |
|
| 2020-05-02 06:51:34 |
Jean-Baptiste Lallement |
zsys (Ubuntu): status |
New |
Triaged |
|
| 2020-05-02 06:51:54 |
Jean-Baptiste Lallement |
nominated for series |
|
Ubuntu Focal |
|
| 2020-05-02 06:51:54 |
Jean-Baptiste Lallement |
bug task added |
|
zsys (Ubuntu Focal) |
|
| 2020-05-02 06:52:00 |
Jean-Baptiste Lallement |
zsys (Ubuntu Focal): status |
New |
Triaged |
|
| 2020-05-02 06:52:03 |
Jean-Baptiste Lallement |
zsys (Ubuntu Focal): importance |
Undecided |
High |
|
| 2020-05-02 06:52:05 |
Jean-Baptiste Lallement |
zsys (Ubuntu Focal): milestone |
|
ubuntu-20.04.1 |
|
| 2020-05-05 14:26:40 |
Sebastien Bacher |
zsys (Ubuntu): assignee |
|
Jean-Baptiste Lallement (jibel) |
|
| 2020-05-05 14:26:45 |
Sebastien Bacher |
zsys (Ubuntu Focal): assignee |
|
Jean-Baptiste Lallement (jibel) |
|
| 2020-05-09 00:39:50 |
satmandu |
bug |
|
|
added subscriber satmandu |
| 2020-05-21 15:41:51 |
Didier Roche-Tolomelli |
summary |
[Focal] zsys does not clear out old snapshots, potentially filling up bpool |
[Focal] zsys still offer auto snapshotting when reach near full disk space |
|
| 2020-05-23 04:13:24 |
Michael-250 |
bug |
|
|
added subscriber Michael-250 |
| 2020-06-03 00:38:52 |
Launchpad Janitor |
zsys (Ubuntu): status |
Triaged |
Fix Released |
|
| 2020-06-09 08:07:57 |
Didier Roche-Tolomelli |
description |
I had been running Focal since the March 4th and installed it via the daily ISO at that time. I opted for ZFS root during the installation process. It was mostly the reason why I went with Focal in the first place.
I ran my frequent, almost daily, apt upgrades to get the latest packages and was happy to see a lot of fixes going in during that period until the release date.
This frequent apt upgrade cadence created a snapshot in rpool/bpool every time. This feature proved useful for me since I was able to restore to a usable state using this once in the past. I was aware of the rpool snapshots, so I was cleaning them out as they built up, but I did not consider the bpool snapshots.
Eventually the small 2GB bpool will fill up with /boot changes and this did happen to me on 30-APR-2020 when I was attempting to upgrade to the latest kernel release. It gave me a cryptic error when trying to run update-initramfs, so I did a G search on the error and it pointed to a disk full situation. When I checked, I saw that only 14MB was free on bpool. I then removed all snapshots that didn't have a coordinating snapshot in rpool and that freed up about 1.2GB in bpool.
I will upload the /var/log/apt/term.log file for the time that I attempted the kernel upgrade and it failed. I will also upload a sosreport from my laptop (which has the same issue at this time without me doing any intervention). It didn't get as many apt updates, so it has free space in bpool still.
I will leave my laptop in the current state in case you need more information. I will probably send snapshot lists from both bpool and rpool on that laptop. (Once again, I did clean up rpool snapshots manually on the laptop).
Let me know if you need more information, log files, command outputs.
Great work on this package so far!
Chris |
[Impact]
* ZSys is still auto snapshooting and allow for state save when reaching full disk space, erroring out.
* We now limit it to 80% of full disk space (either bpool or rpool - which can be tweaked in ZSys configuration file), so that ZSys itself is not responsible for ZFS performance degradation which is considered when disk reach 85% capacity.
* This is covered by an extensive testsuite, for either bpool or rpool or both, both for automated and manual tests.
[Test Case]
1. Ensure the disk has reached more than 80% capacity
2. Run zsysctl save -> it should fail due to max capacity
3. Run sudo zsysctl save --system -> it should fail due to max capacity
4. Run sudo zsysctl save <manual_name> -> it should fail due to max capacity
extra:
1. Try the above on a disk which hasn’t reached this capacity -> the save should work.
[Regression Potential]
* This code impacts automated and manual save and existing tests hasn’t been impacted.
* New tests with mock functionality for simulating disk capacity has been added.
------
I had been running Focal since the March 4th and installed it via the daily ISO at that time. I opted for ZFS root during the installation process. It was mostly the reason why I went with Focal in the first place.
I ran my frequent, almost daily, apt upgrades to get the latest packages and was happy to see a lot of fixes going in during that period until the release date.
This frequent apt upgrade cadence created a snapshot in rpool/bpool every time. This feature proved useful for me since I was able to restore to a usable state using this once in the past. I was aware of the rpool snapshots, so I was cleaning them out as they built up, but I did not consider the bpool snapshots.
Eventually the small 2GB bpool will fill up with /boot changes and this did happen to me on 30-APR-2020 when I was attempting to upgrade to the latest kernel release. It gave me a cryptic error when trying to run update-initramfs, so I did a G search on the error and it pointed to a disk full situation. When I checked, I saw that only 14MB was free on bpool. I then removed all snapshots that didn't have a coordinating snapshot in rpool and that freed up about 1.2GB in bpool.
I will upload the /var/log/apt/term.log file for the time that I attempted the kernel upgrade and it failed. I will also upload a sosreport from my laptop (which has the same issue at this time without me doing any intervention). It didn't get as many apt updates, so it has free space in bpool still.
I will leave my laptop in the current state in case you need more information. I will probably send snapshot lists from both bpool and rpool on that laptop. (Once again, I did clean up rpool snapshots manually on the laptop).
Let me know if you need more information, log files, command outputs.
Great work on this package so far!
Chris |
|
| 2020-06-19 06:37:01 |
Timo Aaltonen |
zsys (Ubuntu Focal): status |
Triaged |
Fix Committed |
|
| 2020-06-19 06:37:04 |
Timo Aaltonen |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2020-06-19 06:37:06 |
Timo Aaltonen |
bug |
|
|
added subscriber SRU Verification |
| 2020-06-19 06:37:11 |
Timo Aaltonen |
tags |
|
verification-needed verification-needed-focal |
|
| 2020-06-24 12:28:01 |
Jean-Baptiste Lallement |
summary |
[Focal] zsys still offer auto snapshotting when reach near full disk space |
[Focal] zsys still offers auto snapshotting when reach near full disk space |
|
| 2020-06-24 12:38:31 |
Jean-Baptiste Lallement |
tags |
verification-needed verification-needed-focal |
verification-done verification-done-focal |
|
| 2020-07-02 08:29:32 |
Launchpad Janitor |
zsys (Ubuntu Focal): status |
Fix Committed |
Fix Released |
|
| 2020-07-02 08:30:08 |
Łukasz Zemczak |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
