| 2019-10-07 14:49:13 |
Andreas Hasenack |
bug |
|
|
added bug |
| 2019-10-08 06:43:38 |
Christian Ehrhardt |
libvirt (Ubuntu): status |
New |
Confirmed |
|
| 2019-10-08 07:40:41 |
Christian Ehrhardt |
bug task added |
|
virt-manager (Ubuntu) |
|
| 2019-10-08 07:40:46 |
Christian Ehrhardt |
virt-manager (Ubuntu): status |
New |
Triaged |
|
| 2019-10-08 07:40:49 |
Christian Ehrhardt |
libvirt (Ubuntu): status |
Confirmed |
Triaged |
|
| 2019-10-08 07:41:01 |
Christian Ehrhardt |
nominated for series |
|
Ubuntu Disco |
|
| 2019-10-08 07:41:01 |
Christian Ehrhardt |
bug task added |
|
libvirt (Ubuntu Disco) |
|
| 2019-10-08 07:41:01 |
Christian Ehrhardt |
bug task added |
|
virt-manager (Ubuntu Disco) |
|
| 2019-10-08 07:41:01 |
Christian Ehrhardt |
nominated for series |
|
Ubuntu Bionic |
|
| 2019-10-08 07:41:01 |
Christian Ehrhardt |
bug task added |
|
libvirt (Ubuntu Bionic) |
|
| 2019-10-08 07:41:01 |
Christian Ehrhardt |
bug task added |
|
virt-manager (Ubuntu Bionic) |
|
| 2019-10-08 07:41:10 |
Christian Ehrhardt |
libvirt (Ubuntu Bionic): status |
New |
Invalid |
|
| 2019-10-08 07:41:12 |
Christian Ehrhardt |
virt-manager (Ubuntu Bionic): status |
New |
Invalid |
|
| 2019-10-08 07:41:14 |
Christian Ehrhardt |
virt-manager (Ubuntu Disco): status |
New |
Triaged |
|
| 2019-10-08 07:41:17 |
Christian Ehrhardt |
libvirt (Ubuntu Disco): status |
New |
Triaged |
|
| 2019-10-08 08:10:46 |
Christian Ehrhardt |
virt-manager (Ubuntu): importance |
Undecided |
Medium |
|
| 2019-10-08 08:10:47 |
Christian Ehrhardt |
virt-manager (Ubuntu Disco): importance |
Undecided |
Medium |
|
| 2019-10-08 08:10:51 |
Christian Ehrhardt |
libvirt (Ubuntu Disco): importance |
Undecided |
Low |
|
| 2019-10-08 08:10:54 |
Christian Ehrhardt |
libvirt (Ubuntu): importance |
Undecided |
Low |
|
| 2019-10-08 08:25:17 |
Christian Ehrhardt |
bug watch added |
|
https://github.com/virt-manager/virt-manager/issues/56 |
|
| 2019-10-08 08:35:26 |
Christian Ehrhardt |
bug watch added |
|
https://bugzilla.redhat.com/show_bug.cgi?id=1759454 |
|
| 2019-10-08 08:35:34 |
Christian Ehrhardt |
bug task added |
|
virt-manager |
|
| 2019-10-08 09:04:04 |
Bug Watch Updater |
virt-manager: status |
Unknown |
Confirmed |
|
| 2019-10-08 09:04:04 |
Bug Watch Updater |
virt-manager: importance |
Unknown |
Undecided |
|
| 2019-10-08 12:56:50 |
Christian Ehrhardt |
bug watch added |
|
https://github.com/zfsonlinux/zfs/issues/326 |
|
| 2019-10-09 10:12:20 |
Christian Ehrhardt |
virt-manager (Ubuntu): importance |
Medium |
Low |
|
| 2019-10-09 10:12:22 |
Christian Ehrhardt |
virt-manager (Ubuntu Disco): importance |
Medium |
Low |
|
| 2019-10-09 10:12:34 |
Christian Ehrhardt |
bug task added |
|
zfs-linux (Ubuntu) |
|
| 2019-10-09 10:13:29 |
Christian Ehrhardt |
bug task added |
|
zfs |
|
| 2019-10-10 10:38:34 |
Bug Watch Updater |
virt-manager: importance |
Undecided |
Low |
|
| 2020-02-08 13:18:52 |
Bug Watch Updater |
zfs: status |
Unknown |
New |
|
| 2020-07-02 19:55:16 |
Steve Langasek |
libvirt (Ubuntu Disco): status |
Triaged |
Won't Fix |
|
| 2020-07-02 19:55:18 |
Steve Langasek |
virt-manager (Ubuntu Disco): status |
Triaged |
Won't Fix |
|
| 2020-07-02 19:56:29 |
Steve Langasek |
zfs-linux (Ubuntu Disco): status |
New |
Won't Fix |
|
| 2020-09-01 07:10:01 |
Bug Watch Updater |
virt-manager: status |
Confirmed |
Fix Released |
|
| 2020-09-01 07:22:22 |
Christian Ehrhardt |
libvirt (Ubuntu Focal): status |
New |
Triaged |
|
| 2020-09-01 16:23:14 |
Colin Ian King |
zfs-linux (Ubuntu Bionic): status |
New |
Won't Fix |
|
| 2020-09-01 16:26:43 |
Colin Ian King |
zfs-linux (Ubuntu): importance |
Undecided |
Low |
|
| 2020-09-03 07:52:50 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~paelzer/ubuntu/+source/libvirt/+git/libvirt/+merge/390220 |
|
| 2020-09-03 09:34:20 |
Bug Watch Updater |
virt-manager: status |
Fix Released |
Confirmed |
|
| 2020-09-21 13:39:49 |
Bug Watch Updater |
virt-manager: status |
Confirmed |
Fix Released |
|
| 2020-09-22 13:11:28 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~paelzer/ubuntu/+source/virt-manager/+git/virt-manager/+merge/391055 |
|
| 2020-09-22 18:35:23 |
Launchpad Janitor |
virt-manager (Ubuntu): status |
Triaged |
Fix Released |
|
| 2020-09-23 05:25:30 |
Launchpad Janitor |
merge proposal linked |
|
https://code.launchpad.net/~paelzer/ubuntu/+source/virt-manager/+git/virt-manager/+merge/391188 |
|
| 2020-09-23 05:44:52 |
Christian Ehrhardt |
description |
This is a regression in eoan for me. I use virt-manager to create vms, and I noticed that creating one now takes more than a minute.
Looking at the process listing while the backing disk is being created, I see this qemu-img command line:
15658 ? Ssl 0:00 /usr/sbin/libvirtd
23726 ? Sl 0:04 \_ /usr/bin/qemu-img create -f qcow2 -o preallocation=falloc,compat=1.1,lazy_refcounts /var/lib/libvirt/images/live-server.qcow2 41943040K
If I run qemu-img with that preallocation parameter set, even on bionic, then it also takes a very long time.
On eoan, for comparison:
andreas@nsn7:~$ time qemu-img create -f qcow2 no-prealloc-image.qcow2 40G
Formatting 'no-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 lazy_refcounts=off refcount_bits=16
real 0m0,016s
user 0m0,010s
sys 0m0,006s
andreas@nsn7:~$ qemu-img info no-prealloc-image.qcow2
image: no-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 17K
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs no-prealloc-image.qcow2
17K no-prealloc-image.qcow2
andreas@nsn7:~$
and now with preallocation=falloc:
andreas@nsn7:~$ time qemu-img create -f qcow2 -o preallocation=falloc with-prealloc-image.qcow2 40G
Formatting 'with-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 preallocation=falloc lazy_refcounts=off refcount_bits=16
real 1m43,196s
user 0m3,564s
sys 1m26,720s
andreas@nsn7:~$ qemu-img info with-prealloc-image.qcow2
image: with-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 2.7M
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs with-prealloc-image.qcow2
2,8M with-prealloc-image.qcow2
andreas@nsn7:~$
ProblemType: Bug
DistroRelease: Ubuntu 19.10
Package: libvirt-daemon 5.4.0-0ubuntu5
ProcVersionSignature: Ubuntu 5.3.0-13.14-generic 5.3.0
Uname: Linux 5.3.0-13-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
ApportVersion: 2.20.11-0ubuntu7
Architecture: amd64
Date: Mon Oct 7 11:36:03 2019
InstallationDate: Installed on 2019-10-07 (0 days ago)
InstallationMedia: Ubuntu 19.10 "Eoan Ermine" - Beta amd64 (20191006)
SourcePackage: libvirt
UpgradeStatus: No upgrade log present (probably fresh install)
modified.conffile..etc.libvirt.nwfilter.allow-arp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-arp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp-server.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp-server.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-incoming-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-incoming-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.allow-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic-gateway.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic-gateway.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-multicast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-multicast.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-broadcast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-broadcast.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-l2-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-l2-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-rarp-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-rarp-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self-rarp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self-rarp.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self.xml']
modified.conffile..etc.libvirt.qemu.conf: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu.conf']
modified.conffile..etc.libvirt.qemu.networks.default.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu/networks/default.xml'] |
[Impact]
* The defaults of virt-manager for disk allocation always worked fine
when qcow2 had nothing but sparse support. So sparse=True vs
sparse=False made no difference. So it always set sparse=False.
Then qcow2 grows non-sparse support, and virt-manager is suddenly
defaulting to it, which is not the intention.
* For upgraders from pre-Focal this was a regression in two ways:
a) allocation of qcow changed to non-sparse (fallocate based)
potentially consuming more space
b) depending on the underlying FS this made the allocation much
slower
* Fix by applying the upstream change that Defaults to sparse when
requested format isn't raw (for raw the assumption ill stay that
users do that for runtime performance, so non-sparse on those stays
as-is)
[Test Case]
* open virt-manager and create a new guest which includes creating a
new image for it
* when clicking "finish" the image will be created (which e.g. on ZFS
will take quite some time)
* In the background grep ps output if the qemu-img call for qcow (the
default) is using "preallocation=fallocate" (wrong) or
"preallocation=metadata" (correct)
[Regression Potential]
* For upgraders from pre-focal it actually ensures behavior stays as is
(no change/regression there)
* For users of ZFS where the allocation was slow it fixes this
slowness.
* But for people using Focal all the time and on non-ZFS there will be
a behavior change in no more doing falloc pre-allocating the qemu
image. To be cleear there are four modes:
1. no allocation
2. metadata allocation - is initially larger but can improve
performance when the image needs to grow
3. falloc - preallocates space for image by calling posix_fallocate
4. full - writes data to the underlying storage
The fix changes the default from 3->2 which it always was and should
be. As the patch says: "If users want to override it, they can
do it via custom created storage."
(To be clear, upstream changed this as we fixed it here, so on
further upgrades what we apply here will be the behavior anyway, it
seems wrong to keep Focal the only one in between kept different)
[Other Info]
* The slowness effect might be further mitigated by ZFS implementing
more falloc options (thanks Richard for that hint) but that won't be
in Focal.
----
This is a regression in eoan for me. I use virt-manager to create vms, and I noticed that creating one now takes more than a minute.
Looking at the process listing while the backing disk is being created, I see this qemu-img command line:
15658 ? Ssl 0:00 /usr/sbin/libvirtd
23726 ? Sl 0:04 \_ /usr/bin/qemu-img create -f qcow2 -o preallocation=falloc,compat=1.1,lazy_refcounts /var/lib/libvirt/images/live-server.qcow2 41943040K
If I run qemu-img with that preallocation parameter set, even on bionic, then it also takes a very long time.
On eoan, for comparison:
andreas@nsn7:~$ time qemu-img create -f qcow2 no-prealloc-image.qcow2 40G
Formatting 'no-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 lazy_refcounts=off refcount_bits=16
real 0m0,016s
user 0m0,010s
sys 0m0,006s
andreas@nsn7:~$ qemu-img info no-prealloc-image.qcow2
image: no-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 17K
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs no-prealloc-image.qcow2
17K no-prealloc-image.qcow2
andreas@nsn7:~$
and now with preallocation=falloc:
andreas@nsn7:~$ time qemu-img create -f qcow2 -o preallocation=falloc with-prealloc-image.qcow2 40G
Formatting 'with-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 preallocation=falloc lazy_refcounts=off refcount_bits=16
real 1m43,196s
user 0m3,564s
sys 1m26,720s
andreas@nsn7:~$ qemu-img info with-prealloc-image.qcow2
image: with-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 2.7M
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs with-prealloc-image.qcow2
2,8M with-prealloc-image.qcow2
andreas@nsn7:~$
ProblemType: Bug
DistroRelease: Ubuntu 19.10
Package: libvirt-daemon 5.4.0-0ubuntu5
ProcVersionSignature: Ubuntu 5.3.0-13.14-generic 5.3.0
Uname: Linux 5.3.0-13-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
ApportVersion: 2.20.11-0ubuntu7
Architecture: amd64
Date: Mon Oct 7 11:36:03 2019
InstallationDate: Installed on 2019-10-07 (0 days ago)
InstallationMedia: Ubuntu 19.10 "Eoan Ermine" - Beta amd64 (20191006)
SourcePackage: libvirt
UpgradeStatus: No upgrade log present (probably fresh install)
modified.conffile..etc.libvirt.nwfilter.allow-arp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-arp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp-server.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp-server.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-incoming-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-incoming-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.allow-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic-gateway.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic-gateway.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-multicast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-multicast.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-broadcast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-broadcast.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-l2-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-l2-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-rarp-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-rarp-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self-rarp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self-rarp.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self.xml']
modified.conffile..etc.libvirt.qemu.conf: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu.conf']
modified.conffile..etc.libvirt.qemu.networks.default.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu/networks/default.xml'] |
|
| 2020-09-29 11:11:31 |
Robie Basak |
tags |
amd64 apport-bug eoan |
amd64 apport-bug eoan focal regression-release |
|
| 2020-09-29 11:27:31 |
Robie Basak |
description |
[Impact]
* The defaults of virt-manager for disk allocation always worked fine
when qcow2 had nothing but sparse support. So sparse=True vs
sparse=False made no difference. So it always set sparse=False.
Then qcow2 grows non-sparse support, and virt-manager is suddenly
defaulting to it, which is not the intention.
* For upgraders from pre-Focal this was a regression in two ways:
a) allocation of qcow changed to non-sparse (fallocate based)
potentially consuming more space
b) depending on the underlying FS this made the allocation much
slower
* Fix by applying the upstream change that Defaults to sparse when
requested format isn't raw (for raw the assumption ill stay that
users do that for runtime performance, so non-sparse on those stays
as-is)
[Test Case]
* open virt-manager and create a new guest which includes creating a
new image for it
* when clicking "finish" the image will be created (which e.g. on ZFS
will take quite some time)
* In the background grep ps output if the qemu-img call for qcow (the
default) is using "preallocation=fallocate" (wrong) or
"preallocation=metadata" (correct)
[Regression Potential]
* For upgraders from pre-focal it actually ensures behavior stays as is
(no change/regression there)
* For users of ZFS where the allocation was slow it fixes this
slowness.
* But for people using Focal all the time and on non-ZFS there will be
a behavior change in no more doing falloc pre-allocating the qemu
image. To be cleear there are four modes:
1. no allocation
2. metadata allocation - is initially larger but can improve
performance when the image needs to grow
3. falloc - preallocates space for image by calling posix_fallocate
4. full - writes data to the underlying storage
The fix changes the default from 3->2 which it always was and should
be. As the patch says: "If users want to override it, they can
do it via custom created storage."
(To be clear, upstream changed this as we fixed it here, so on
further upgrades what we apply here will be the behavior anyway, it
seems wrong to keep Focal the only one in between kept different)
[Other Info]
* The slowness effect might be further mitigated by ZFS implementing
more falloc options (thanks Richard for that hint) but that won't be
in Focal.
----
This is a regression in eoan for me. I use virt-manager to create vms, and I noticed that creating one now takes more than a minute.
Looking at the process listing while the backing disk is being created, I see this qemu-img command line:
15658 ? Ssl 0:00 /usr/sbin/libvirtd
23726 ? Sl 0:04 \_ /usr/bin/qemu-img create -f qcow2 -o preallocation=falloc,compat=1.1,lazy_refcounts /var/lib/libvirt/images/live-server.qcow2 41943040K
If I run qemu-img with that preallocation parameter set, even on bionic, then it also takes a very long time.
On eoan, for comparison:
andreas@nsn7:~$ time qemu-img create -f qcow2 no-prealloc-image.qcow2 40G
Formatting 'no-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 lazy_refcounts=off refcount_bits=16
real 0m0,016s
user 0m0,010s
sys 0m0,006s
andreas@nsn7:~$ qemu-img info no-prealloc-image.qcow2
image: no-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 17K
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs no-prealloc-image.qcow2
17K no-prealloc-image.qcow2
andreas@nsn7:~$
and now with preallocation=falloc:
andreas@nsn7:~$ time qemu-img create -f qcow2 -o preallocation=falloc with-prealloc-image.qcow2 40G
Formatting 'with-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 preallocation=falloc lazy_refcounts=off refcount_bits=16
real 1m43,196s
user 0m3,564s
sys 1m26,720s
andreas@nsn7:~$ qemu-img info with-prealloc-image.qcow2
image: with-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 2.7M
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs with-prealloc-image.qcow2
2,8M with-prealloc-image.qcow2
andreas@nsn7:~$
ProblemType: Bug
DistroRelease: Ubuntu 19.10
Package: libvirt-daemon 5.4.0-0ubuntu5
ProcVersionSignature: Ubuntu 5.3.0-13.14-generic 5.3.0
Uname: Linux 5.3.0-13-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
ApportVersion: 2.20.11-0ubuntu7
Architecture: amd64
Date: Mon Oct 7 11:36:03 2019
InstallationDate: Installed on 2019-10-07 (0 days ago)
InstallationMedia: Ubuntu 19.10 "Eoan Ermine" - Beta amd64 (20191006)
SourcePackage: libvirt
UpgradeStatus: No upgrade log present (probably fresh install)
modified.conffile..etc.libvirt.nwfilter.allow-arp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-arp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp-server.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp-server.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-incoming-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-incoming-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.allow-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic-gateway.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic-gateway.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-multicast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-multicast.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-broadcast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-broadcast.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-l2-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-l2-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-rarp-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-rarp-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self-rarp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self-rarp.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self.xml']
modified.conffile..etc.libvirt.qemu.conf: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu.conf']
modified.conffile..etc.libvirt.qemu.networks.default.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu/networks/default.xml'] |
[Impact]
* The defaults of virt-manager for disk allocation always worked fine
when qcow2 had nothing but sparse support. So sparse=True vs
sparse=False made no difference. So it always set sparse=False.
Then qcow2 grows non-sparse support, and virt-manager is suddenly
defaulting to it, which is not the intention.
* For upgraders from pre-Focal this was a regression in two ways:
a) allocation of qcow changed to non-sparse (fallocate based)
potentially consuming more space
b) depending on the underlying FS this made the allocation much
slower
* Fix by applying the upstream change that Defaults to sparse when
requested format isn't raw (for raw the assumption ill stay that
users do that for runtime performance, so non-sparse on those stays
as-is)
[Test Case]
* open virt-manager and create a new guest which includes creating a
new image for it
* when clicking "finish" the image will be created (which e.g. on ZFS
will take quite some time)
* In the background grep ps output if the qemu-img call for qcow (the
default) is using "preallocation=fallocate" (wrong) or
"preallocation=metadata" (correct)
[Regression Potential]
* For upgraders from pre-focal it actually ensures behavior stays as is
(no change/regression there)
* For users of ZFS where the allocation was slow it fixes this
slowness.
* But for people using Focal all the time and on non-ZFS there will be
a behavior change in no more doing falloc pre-allocating the qemu
image. To be cleear there are four modes:
1. no allocation
2. metadata allocation - is initially larger but can improve
performance when the image needs to grow
3. falloc - preallocates space for image by calling posix_fallocate
4. full - writes data to the underlying storage
The fix changes the default from 3->2 which it always was and should
be. As the patch says: "If users want to override it, they can
do it via custom created storage."
(To be clear, upstream changed this as we fixed it here, so on
further upgrades what we apply here will be the behavior anyway, it
seems wrong to keep Focal the only one in between kept different)
* [racb] The code path being added special cases the 'raw' format and in handling of the default sparse setting. Areas of potential regression are therefore in the handling of the default and override of the default in the cases of both 'raw' and not 'raw'.
[Other Info]
* The slowness effect might be further mitigated by ZFS implementing
more falloc options (thanks Richard for that hint) but that won't be
in Focal.
----
This is a regression in eoan for me. I use virt-manager to create vms, and I noticed that creating one now takes more than a minute.
Looking at the process listing while the backing disk is being created, I see this qemu-img command line:
15658 ? Ssl 0:00 /usr/sbin/libvirtd
23726 ? Sl 0:04 \_ /usr/bin/qemu-img create -f qcow2 -o preallocation=falloc,compat=1.1,lazy_refcounts /var/lib/libvirt/images/live-server.qcow2 41943040K
If I run qemu-img with that preallocation parameter set, even on bionic, then it also takes a very long time.
On eoan, for comparison:
andreas@nsn7:~$ time qemu-img create -f qcow2 no-prealloc-image.qcow2 40G
Formatting 'no-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 lazy_refcounts=off refcount_bits=16
real 0m0,016s
user 0m0,010s
sys 0m0,006s
andreas@nsn7:~$ qemu-img info no-prealloc-image.qcow2
image: no-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 17K
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs no-prealloc-image.qcow2
17K no-prealloc-image.qcow2
andreas@nsn7:~$
and now with preallocation=falloc:
andreas@nsn7:~$ time qemu-img create -f qcow2 -o preallocation=falloc with-prealloc-image.qcow2 40G
Formatting 'with-prealloc-image.qcow2', fmt=qcow2 size=42949672960 cluster_size=65536 preallocation=falloc lazy_refcounts=off refcount_bits=16
real 1m43,196s
user 0m3,564s
sys 1m26,720s
andreas@nsn7:~$ qemu-img info with-prealloc-image.qcow2
image: with-prealloc-image.qcow2
file format: qcow2
virtual size: 40G (42949672960 bytes)
disk size: 2.7M
cluster_size: 65536
Format specific information:
compat: 1.1
lazy refcounts: false
refcount bits: 16
corrupt: false
andreas@nsn7:~$ du -hs with-prealloc-image.qcow2
2,8M with-prealloc-image.qcow2
andreas@nsn7:~$
ProblemType: Bug
DistroRelease: Ubuntu 19.10
Package: libvirt-daemon 5.4.0-0ubuntu5
ProcVersionSignature: Ubuntu 5.3.0-13.14-generic 5.3.0
Uname: Linux 5.3.0-13-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair
ApportVersion: 2.20.11-0ubuntu7
Architecture: amd64
Date: Mon Oct 7 11:36:03 2019
InstallationDate: Installed on 2019-10-07 (0 days ago)
InstallationMedia: Ubuntu 19.10 "Eoan Ermine" - Beta amd64 (20191006)
SourcePackage: libvirt
UpgradeStatus: No upgrade log present (probably fresh install)
modified.conffile..etc.libvirt.nwfilter.allow-arp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-arp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp-server.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp-server.xml']
modified.conffile..etc.libvirt.nwfilter.allow-dhcp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-dhcp.xml']
modified.conffile..etc.libvirt.nwfilter.allow-incoming-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-incoming-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.allow-ipv4.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/allow-ipv4.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic-gateway.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic-gateway.xml']
modified.conffile..etc.libvirt.nwfilter.clean-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/clean-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-arp-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-arp-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-multicast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-multicast.xml']
modified.conffile..etc.libvirt.nwfilter.no-ip-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-ip-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-broadcast.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-broadcast.xml']
modified.conffile..etc.libvirt.nwfilter.no-mac-spoofing.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-mac-spoofing.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-l2-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-l2-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.no-other-rarp-traffic.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/no-other-rarp-traffic.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self-rarp.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self-rarp.xml']
modified.conffile..etc.libvirt.nwfilter.qemu-announce-self.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/nwfilter/qemu-announce-self.xml']
modified.conffile..etc.libvirt.qemu.conf: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu.conf']
modified.conffile..etc.libvirt.qemu.networks.default.xml: [inaccessible: [Errno 13] Permission denied: '/etc/libvirt/qemu/networks/default.xml'] |
|
| 2020-09-29 12:58:05 |
Robie Basak |
virt-manager (Ubuntu Focal): status |
New |
Fix Committed |
|
| 2020-09-29 12:58:07 |
Robie Basak |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2020-09-29 12:58:08 |
Robie Basak |
bug |
|
|
added subscriber SRU Verification |
| 2020-09-29 12:58:12 |
Robie Basak |
tags |
amd64 apport-bug eoan focal regression-release |
amd64 apport-bug eoan focal regression-release verification-needed verification-needed-focal |
|
| 2020-09-30 08:28:28 |
Christian Ehrhardt |
tags |
amd64 apport-bug eoan focal regression-release verification-needed verification-needed-focal |
amd64 apport-bug eoan focal regression-release verification-done verification-done-focal |
|
| 2020-10-06 15:51:58 |
Launchpad Janitor |
virt-manager (Ubuntu Focal): status |
Fix Committed |
Fix Released |
|
| 2020-10-06 15:52:03 |
Brian Murray |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2021-04-09 14:33:54 |
Colin Ian King |
zfs-linux (Ubuntu): importance |
Low |
Undecided |
|
| 2021-04-09 14:33:54 |
Colin Ian King |
zfs-linux (Ubuntu): status |
New |
Won't Fix |
|
| 2022-04-01 22:21:25 |
Bug Watch Updater |
zfs: status |
New |
Fix Released |
|
