| 2010-04-27 16:08:58 |
Dustin Kirkland |
bug |
|
|
added bug |
| 2010-04-27 16:09:23 |
Dustin Kirkland |
dpkg (Ubuntu): importance |
Undecided |
High |
|
| 2010-04-27 16:09:28 |
Dustin Kirkland |
dpkg (Ubuntu): status |
New |
Triaged |
|
| 2010-04-27 16:09:44 |
Dustin Kirkland |
dpkg (Ubuntu): assignee |
|
Thierry Carrez (ttx) |
|
| 2010-04-27 16:13:07 |
Dustin Kirkland |
tags |
|
regression-potential |
|
| 2010-04-27 16:16:31 |
Dustin Kirkland |
nominated for series |
|
Ubuntu Lucid |
|
| 2010-04-27 16:16:31 |
Dustin Kirkland |
bug task added |
|
dpkg (Ubuntu Lucid) |
|
| 2010-04-27 16:36:11 |
Thierry Carrez |
dpkg (Ubuntu Lucid): assignee |
Thierry Carrez (ttx) |
|
|
| 2010-04-27 16:37:11 |
Thierry Carrez |
bug task added |
|
ubuntu-release-notes |
|
| 2010-04-27 17:59:42 |
Dustin Kirkland |
summary |
[regression] dpkg fsync cause massive regression in Ubuntu Server installation times |
[regression] dpkg fsync cause massive regression in Ubuntu Server and Alternate installation times |
|
| 2010-04-27 21:20:17 |
Ubuntu QA Website |
tags |
regression-potential |
iso-testing regression-potential |
|
| 2010-04-28 21:51:30 |
Colin Watson |
ubuntu-release-notes: status |
New |
Fix Released |
|
| 2010-04-28 21:51:30 |
Colin Watson |
ubuntu-release-notes: assignee |
|
Colin Watson (cjwatson) |
|
| 2010-05-05 13:53:43 |
Jean-Baptiste Lallement |
bug watch added |
|
http://bugzilla.kernel.org/show_bug.cgi?id=15910 |
|
| 2010-05-05 13:53:43 |
Jean-Baptiste Lallement |
bug task added |
|
linux |
|
| 2010-05-14 12:45:34 |
pb2004 |
removed subscriber pb2004 |
|
|
|
| 2010-06-27 14:05:49 |
Dustin Kirkland |
summary |
[regression] dpkg fsync cause massive regression in Ubuntu Server and Alternate installation times |
[regression] dpkg's fsync causes massive regression in Ubuntu Server and Alternate installation times |
|
| 2010-06-27 15:31:15 |
Artem Popov |
bug |
|
|
added subscriber Артём Попов |
| 2010-06-28 14:24:19 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid/dpkg |
|
| 2010-06-28 14:37:14 |
Colin Watson |
dpkg (Ubuntu): status |
Triaged |
Fix Released |
|
| 2010-06-28 14:42:21 |
Colin Watson |
dpkg (Ubuntu Lucid): assignee |
|
Colin Watson (cjwatson) |
|
| 2010-06-28 14:42:26 |
Colin Watson |
dpkg (Ubuntu Lucid): status |
Triaged |
In Progress |
|
| 2010-06-28 14:46:53 |
Colin Watson |
description |
Binary package hint: dpkg
dpkg (1.15.5.6ubuntu4) causes a massive regression in the installation of the Ubuntu Server.
Specifically, this from the changelog, addressing Bug #559915:
- Restore fsync during package unpack (LP: #559915). This is now done
by deferring the fsync and rename for normal files in tar extraction
so that it's done in one pass afterwards, to avoid massive I/O
degradation due to the serialization from each write + fsync. When
creating hard links to normal files on extraction use the .dpkg-new
filename for source as the file is not yet in place due to the rename
deferral.
I just installed the same hardware, from the same USB stick, in an identical configuration, one on ext4 and the other on ext3.
On ext4, this took 19 minutes, 20 seconds. On ext3, this took 9 minutes, 8 seconds.
This is a 100% performance hit on Server installs. It takes now takes over twice as long to install Ubuntu servers.
While I can understand that the fsyncs() are necessary for power loss situations on apt-get upgrade/dpkg operations *after* the system has been installed, it should not be necessary at Server install time. If you lose power during a d-i installation, you will clearly need to start from scratch anyway.
The desktop installer does not suffer from this since ubiquity installations simply transfer the live image. |
Binary package hint: dpkg
dpkg (1.15.5.6ubuntu4) causes a massive regression in the installation of the Ubuntu Server.
Specifically, this from the changelog, addressing Bug #559915:
- Restore fsync during package unpack (LP: #559915). This is now done
by deferring the fsync and rename for normal files in tar extraction
so that it's done in one pass afterwards, to avoid massive I/O
degradation due to the serialization from each write + fsync. When
creating hard links to normal files on extraction use the .dpkg-new
filename for source as the file is not yet in place due to the rename
deferral.
I just installed the same hardware, from the same USB stick, in an identical configuration, one on ext4 and the other on ext3.
On ext4, this took 19 minutes, 20 seconds. On ext3, this took 9 minutes, 8 seconds.
This is a 100% performance hit on Server installs. It takes now takes over twice as long to install Ubuntu servers.
While I can understand that the fsyncs() are necessary for power loss situations on apt-get upgrade/dpkg operations *after* the system has been installed, it should not be necessary at Server install time. If you lose power during a d-i installation, you will clearly need to start from scratch anyway.
The desktop installer does not suffer from this since ubiquity installations simply transfer the live image.
DEVELOPMENT BRANCH: Addressed in a merge from Debian by using one large sync before embarking on renames, rather than lots of little fsyncs.
PATCH: http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/lucid/dpkg/lucid/revision/95
TEST CASE: Install Ubuntu Server; measure time taken in "Select and install software" step. Compare 10.04 as released to the 10.04.1 candidate CD images which should be available for testing in the near future. |
|
| 2010-06-28 14:51:14 |
Martin Pitt |
dpkg (Ubuntu Lucid): status |
In Progress |
Fix Committed |
|
| 2010-06-28 14:51:20 |
Martin Pitt |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2010-06-28 14:51:24 |
Martin Pitt |
bug |
|
|
added subscriber SRU Verification |
| 2010-06-28 14:51:31 |
Martin Pitt |
tags |
iso-testing regression-potential |
iso-testing regression-potential verification-needed |
|
| 2010-06-28 15:31:14 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid-proposed/dpkg |
|
| 2010-06-28 20:15:25 |
totya |
bug |
|
|
added subscriber totya |
| 2010-07-14 06:02:28 |
Martin Pitt |
tags |
iso-testing regression-potential verification-needed |
iso-testing regression-release verification-done |
|
| 2010-07-14 06:03:19 |
Launchpad Janitor |
dpkg (Ubuntu Lucid): status |
Fix Committed |
Fix Released |
|
| 2010-07-15 19:09:41 |
hanasaki |
bug |
|
|
added subscriber hanasaki |
| 2010-07-19 08:11:43 |
Oibaf |
removed subscriber Fabio Pedretti |
|
|
|
| 2010-07-19 08:12:26 |
Oibaf |
bug |
|
|
added subscriber Fabio Pedretti |
| 2010-08-09 09:19:50 |
pb2004 |
removed subscriber pb2004 |
|
|
|
| 2010-08-09 09:20:27 |
pb2004 |
bug |
|
|
added subscriber pb2004 |
| 2010-11-19 08:30:30 |
Gary M |
bug |
|
|
added subscriber Gary M |
| 2011-01-24 08:23:30 |
Bug Watch Updater |
linux: status |
Unknown |
Confirmed |
|
| 2011-02-03 07:11:21 |
D-lyte |
security vulnerability |
no |
yes |
|
| 2011-02-03 07:59:22 |
D-lyte |
bug task added |
|
dpkg (Unity Linux) |
|
| 2011-02-03 09:15:35 |
Martin Pitt |
security vulnerability |
yes |
no |
|
| 2011-02-03 13:55:41 |
Bug Watch Updater |
linux: importance |
Unknown |
Medium |
|
| 2011-03-07 00:36:08 |
Phillip Susi |
dpkg (Unity Linux): status |
New |
Invalid |
|
| 2011-03-10 07:22:05 |
Bug Watch Updater |
linux: status |
Confirmed |
Invalid |
|
| 2011-09-19 21:15:19 |
Ubuntu Foundations Team Bug Bot |
tags |
iso-testing regression-release verification-done |
iso-testing regression-release testcase verification-done |
|
| 2011-12-05 17:15:48 |
Diego Morales |
bug |
|
|
added subscriber Diego Morales |
