| 2015-04-16 22:24:06 |
Shahbaz Youssefi |
bug |
|
|
added bug |
| 2015-04-16 22:24:06 |
Shahbaz Youssefi |
attachment added |
|
The 0x10000 bytes that repeat indefinitely during apt's update https://bugs.launchpad.net/bugs/1445239/+attachment/4377852/+files/apt-error-repeating-bytes |
|
| 2015-04-17 16:11:42 |
Shahbaz Youssefi |
attachment added |
|
The 0x10000 bytes repeating data for another case of this error https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1445239/+attachment/4378477/+files/apt-error-repeating-bytes-2 |
|
| 2015-04-20 10:23:19 |
Launchpad Janitor |
apt (Ubuntu): status |
New |
Confirmed |
|
| 2015-04-20 14:44:01 |
Alberto Salvia Novella |
apt (Ubuntu): importance |
Undecided |
Critical |
|
| 2015-04-20 14:45:08 |
Alberto Salvia Novella |
nominated for series |
|
Ubuntu Vivid |
|
| 2015-04-20 14:47:48 |
Alberto Salvia Novella |
bug task added |
|
apt |
|
| 2015-04-20 14:48:50 |
Alberto Salvia Novella |
apt (Ubuntu): status |
Confirmed |
Incomplete |
|
| 2015-04-20 14:49:05 |
Alberto Salvia Novella |
tags |
amd64 apport-bug vivid |
amd64 apport-bug asked-to-upstream vivid |
|
| 2015-04-20 14:49:12 |
Alberto Salvia Novella |
bug |
|
|
added subscriber Alberto Salvia Novella |
| 2015-04-20 16:44:47 |
Brian Murray |
apt (Ubuntu): importance |
Critical |
High |
|
| 2015-04-20 16:51:09 |
Brian Murray |
apt (Ubuntu): status |
Incomplete |
Confirmed |
|
| 2015-04-20 17:34:51 |
Brian Murray |
bug |
|
|
added subscriber Brian Murray |
| 2015-04-20 17:50:35 |
Alberto Salvia Novella |
removed subscriber Alberto Salvia Novella |
|
|
|
| 2015-04-22 20:45:47 |
Brian Murray |
apt (Ubuntu): status |
Confirmed |
Incomplete |
|
| 2015-04-30 12:20:03 |
Andreas Brudin |
bug |
|
|
added subscriber Andreas Brudin |
| 2015-04-30 22:52:47 |
Anton Blanchard |
bug |
|
|
added subscriber Anton Blanchard |
| 2015-05-02 00:16:23 |
Adam Conrad |
bug task added |
|
apt (Ubuntu Vivid) |
|
| 2015-05-02 00:16:38 |
Adam Conrad |
apt (Ubuntu Vivid): status |
Incomplete |
Confirmed |
|
| 2015-05-02 00:17:01 |
Adam Conrad |
bug |
|
|
added subscriber Michael Vogt |
| 2015-05-04 09:37:22 |
bart |
bug |
|
|
added subscriber bart |
| 2015-05-06 22:31:38 |
Brian Murray |
tags |
amd64 apport-bug asked-to-upstream vivid |
amd64 apport-bug asked-to-upstream rls-w-incoming vivid |
|
| 2015-05-13 01:02:17 |
Anton Blanchard |
attachment added |
|
Don't parse Content-Length if Content-Range has been parsed https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1445239/+attachment/4396561/+files/apt-fills-disk.patch |
|
| 2015-05-13 01:03:02 |
Adam Conrad |
apt (Ubuntu): assignee |
|
Michael Vogt (mvo) |
|
| 2015-05-13 01:03:09 |
Adam Conrad |
apt (Ubuntu Vivid): assignee |
|
Michael Vogt (mvo) |
|
| 2015-05-13 04:17:27 |
Ubuntu Foundations Team Bug Bot |
tags |
amd64 apport-bug asked-to-upstream rls-w-incoming vivid |
amd64 apport-bug asked-to-upstream patch rls-w-incoming vivid |
|
| 2015-05-13 04:17:36 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Ubuntu Review Team |
| 2015-05-22 12:20:59 |
Michael Vogt |
apt (Ubuntu): status |
Confirmed |
In Progress |
|
| 2015-05-24 01:49:50 |
Launchpad Janitor |
apt (Ubuntu): status |
In Progress |
Fix Released |
|
| 2015-05-24 13:52:08 |
Launchpad Janitor |
branch linked |
|
lp:debian/apt |
|
| 2015-05-29 15:07:21 |
Brian Murray |
removed subscriber Ubuntu Review Team |
|
|
|
| 2015-06-01 17:23:50 |
David L |
bug |
|
|
added subscriber David L |
| 2015-06-10 14:37:04 |
Michael Vogt |
description |
Since I upgraded to vivid, apt fills the disk space at /var/lib/apt/lists/partial. This was triggered by the automatic update every day, and as a solution I killed the processes named `http` spawned by apt, and removed the offending file from lists/partial manually. Until now, `apt-get update` and `apt-get upgrade` had been working. However, today, when I tried `apt-get update`, it got stuck in some file, continuously increasing its size when at 100%.
I tried inspecting the file to see if there is a repetition of data, and there seems to be, as I have suspected.
First of all, the file is it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 this time, but I'm not sure if the previous time it was also this file.
I used `tail` and `hexdump` to figure out whether a certain pattern shows up in the file. Here are some examples:
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<bbdf\>'
0000c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0010c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0020c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0030c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<9b95\>'
0000c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0010c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0020c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0030c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<1234\>'
0002630 fd50 b08d 7082 1234 85b3 a61e 2921 e0cd
0012630 fd50 b08d 7082 1234 85b3 a61e 2921 e0cd
0022630 fd50 b08d 7082 1234 85b3 a61e 2921 e0cd
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<76a8\>'
000fa90 747d 76a8 078a 67b6 60d9 83f5 5ff3 787c
001fa90 747d 76a8 078a 67b6 60d9 83f5 5ff3 787c
002fa90 747d 76a8 078a 67b6 60d9 83f5 5ff3 787c
As you can see, it seems that after the error, a certain pattern seems to repeat every exactly 0x10000 bytes. I attached a copy of those 0x10000 bytes that keep repeating (from an arbitrary offset).
---
$ lsb_release -rd
Description: Ubuntu Vivid Vervet (development branch)
Release: 15.04
$ apt-cache policy apt
apt:
Installed: 1.0.9.7ubuntu4
Candidate: 1.0.9.7ubuntu4
Version table:
*** 1.0.9.7ubuntu4 0
500 http://it.archive.ubuntu.com/ubuntu/ vivid/main amd64 Packages
100 /var/lib/dpkg/status
---
Do let me know if I can test further to see what could be wrong. I'll keep an eye next times the behavior repeat to make sure the file is the same / the pattern is the same and I'll report back. If you think the problem could be the Italy server, let me know and I'll try with a different one.
ProblemType: Bug
DistroRelease: Ubuntu 15.04
Package: apt 1.0.9.7ubuntu4
ProcVersionSignature: Ubuntu 3.19.0-13.13-generic 3.19.3
Uname: Linux 3.19.0-13-generic x86_64
NonfreeKernelModules: nvidia
ApportVersion: 2.17-0ubuntu2
Architecture: amd64
CurrentDesktop: Unity
Date: Fri Apr 17 00:04:05 2015
SourcePackage: apt
UpgradeStatus: Upgraded to vivid on 2015-03-28 (19 days ago) |
Test case:
- there is a artificial test in test/integration now
- as this is server side dependent a regression test should be enough
Since I upgraded to vivid, apt fills the disk space at /var/lib/apt/lists/partial. This was triggered by the automatic update every day, and as a solution I killed the processes named `http` spawned by apt, and removed the offending file from lists/partial manually. Until now, `apt-get update` and `apt-get upgrade` had been working. However, today, when I tried `apt-get update`, it got stuck in some file, continuously increasing its size when at 100%.
I tried inspecting the file to see if there is a repetition of data, and there seems to be, as I have suspected.
First of all, the file is it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 this time, but I'm not sure if the previous time it was also this file.
I used `tail` and `hexdump` to figure out whether a certain pattern shows up in the file. Here are some examples:
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<bbdf\>'
0000c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0010c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0020c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0030c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<9b95\>'
0000c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0010c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0020c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
0030c80 8d9e 63ad bbdf 40a7 3f3e 2b4a 9b95 aa5a
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<1234\>'
0002630 fd50 b08d 7082 1234 85b3 a61e 2921 e0cd
0012630 fd50 b08d 7082 1234 85b3 a61e 2921 e0cd
0022630 fd50 b08d 7082 1234 85b3 a61e 2921 e0cd
$ tail -c 200000 it.archive.ubuntu.com_ubuntu_dists_vivid_main_binary-i386_Packages.bz2 | hexdump | grep '\<76a8\>'
000fa90 747d 76a8 078a 67b6 60d9 83f5 5ff3 787c
001fa90 747d 76a8 078a 67b6 60d9 83f5 5ff3 787c
002fa90 747d 76a8 078a 67b6 60d9 83f5 5ff3 787c
As you can see, it seems that after the error, a certain pattern seems to repeat every exactly 0x10000 bytes. I attached a copy of those 0x10000 bytes that keep repeating (from an arbitrary offset).
---
$ lsb_release -rd
Description: Ubuntu Vivid Vervet (development branch)
Release: 15.04
$ apt-cache policy apt
apt:
Installed: 1.0.9.7ubuntu4
Candidate: 1.0.9.7ubuntu4
Version table:
*** 1.0.9.7ubuntu4 0
500 http://it.archive.ubuntu.com/ubuntu/ vivid/main amd64 Packages
100 /var/lib/dpkg/status
---
Do let me know if I can test further to see what could be wrong. I'll keep an eye next times the behavior repeat to make sure the file is the same / the pattern is the same and I'll report back. If you think the problem could be the Italy server, let me know and I'll try with a different one.
ProblemType: Bug
DistroRelease: Ubuntu 15.04
Package: apt 1.0.9.7ubuntu4
ProcVersionSignature: Ubuntu 3.19.0-13.13-generic 3.19.3
Uname: Linux 3.19.0-13-generic x86_64
NonfreeKernelModules: nvidia
ApportVersion: 2.17-0ubuntu2
Architecture: amd64
CurrentDesktop: Unity
Date: Fri Apr 17 00:04:05 2015
SourcePackage: apt
UpgradeStatus: Upgraded to vivid on 2015-03-28 (19 days ago) |
|
| 2015-06-10 14:37:07 |
Michael Vogt |
apt (Ubuntu Vivid): status |
Confirmed |
In Progress |
|
| 2015-06-10 14:37:13 |
Michael Vogt |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2015-06-15 19:56:39 |
Brian Murray |
apt (Ubuntu Vivid): status |
In Progress |
Fix Committed |
|
| 2015-06-15 19:56:44 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2015-06-15 19:56:50 |
Brian Murray |
tags |
amd64 apport-bug asked-to-upstream patch rls-w-incoming vivid |
amd64 apport-bug asked-to-upstream patch rls-w-incoming verification-needed vivid |
|
| 2015-06-21 07:58:54 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/vivid-proposed/apt |
|
| 2015-07-01 08:06:35 |
magowiz |
bug |
|
|
added subscriber magowiz |
| 2015-07-07 22:51:03 |
Samuel Echeverry |
bug |
|
|
added subscriber Samuel Echeverry |
| 2015-07-17 22:31:00 |
Rafael Jesus Alcantara Perez |
bug |
|
|
added subscriber Rafael Jesus Alcantara Perez |
| 2015-07-31 14:12:50 |
Josh Holtrop |
bug |
|
|
added subscriber Josh Holtrop |
| 2015-08-01 07:36:39 |
Adam Conrad |
tags |
amd64 apport-bug asked-to-upstream patch rls-w-incoming verification-needed vivid |
amd64 apport-bug asked-to-upstream patch rls-w-incoming verification-done vivid |
|
| 2015-08-01 07:37:42 |
Launchpad Janitor |
apt (Ubuntu Vivid): status |
Fix Committed |
Fix Released |
|
| 2015-08-01 07:37:46 |
Adam Conrad |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2015-09-05 16:29:47 |
Launchpad Janitor |
branch linked |
|
lp:debian/jessie/apt |
|
