Corrupt files on download

Bug #883338 reported by Eliot Gable
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
Expired
Undecided
Unassigned

Bug Description

The correct checksum for this download is 436d550bfc724f0be3ad8b04e47b831d1b9d2fe4. Each time I download it, I get something different, as seen below:

egable@mobit:~$ wget 'http://ftp.ussg.iu.edu/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'
--2011-10-28 19:41:29-- http://ftp.ussg.iu.edu/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
Resolving ftp.ussg.iu.edu... 156.56.247.193
Connecting to ftp.ussg.iu.edu|156.56.247.193|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 149247972 (142M) [application/x-gzip]
Saving to: `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'

100%[======================================================================================================================>] 149,247,972 1.41M/s in 5m 30s

2011-10-28 19:46:59 (442 KB/s) - `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz' saved [149247972/149247972]

egable@mobit:~$ sha1sum eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
436d550bfc724f0be3ad8b04e47b831d1b9d2fe4 eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
egable@mobit:~$ rm -f eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
egable@mobit:~$ wget 'http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'--2011-10-28 19:48:28-- http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
Resolving ftp.osuosl.org... 64.50.236.52, 64.50.233.100
Connecting to ftp.osuosl.org|64.50.236.52|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 149247972 (142M) [application/x-gzip]
Saving to: `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'

100%[======================================================================================================================>] 149,247,972 765K/s in 3m 34s

2011-10-28 19:52:05 (682 KB/s) - `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz' saved [149247972/149247972]

egable@mobit:~$ sha1sum eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz ac4f3b28da5d46f8ee664c7cee015470aa6d67b8 eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
egable@mobit:~$ rm -f eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz egable@mobit:~$ wget 'http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'
--2011-10-28 19:53:57-- http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
Resolving ftp.osuosl.org... 64.50.236.52, 64.50.233.100
Connecting to ftp.osuosl.org|64.50.236.52|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 149247972 (142M) [application/x-gzip]
Saving to: `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'

100%[======================================================================================================================>] 149,247,972 1.39M/s in 3m 36s

2011-10-28 19:57:34 (673 KB/s) - `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz' saved [149247972/149247972]

egable@mobit:~$ sha1sum eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz 436d550bfc724f0be3ad8b04e47b831d1b9d2fe4 eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz

These are just a couple of examples. I have reproduced this on my Ubuntu 11.10 laptop, a Ubuntu 11.10 VM running under VirtualBox with a Windows 7 Ultimate Host on a Core i5 Desktop with 8 GB RAM and a OCZ RevoDrive SSD, and as a bare-metal install on a Core i7 Desktop with 16 GB RAM using an OCZ Vertex 3 SSD. That's three separate systems with the only thing in common being Ubuntu 11.10. The Core i7 was running Server edition and the other two were running Desktop edition. I have a fourth system running CentOS 6 which downloads the file correctly every single time. Further, the Windows 7 host downloads the file correctly every single time. When running the Windows 7 host on the Core i7 hardware (by just moving the boot drive over the Core i7 system) it also downloads correctly there every time. The Core i7 system is brand new (arrived in the mail yesterday).

When the SHA1 checksum displays incorrectly, attempting to unpack the download results in gzip complaining about corrupted data and the unpacking fails.

In addition, I have tested using wget, ncftpget, curl, chrome, and firefox. All methods of downloading the file I have tested result in sometimes getting a corrupted file and sometimes getting an uncorrupted file. I have tested 6 different mirrors and gotten both corrupted and uncorrupted versions from all 6 mirrors. When the sha1sum is incorrect, it never repeats any other incorrect checksum. This means it is corrupted differently every time it gets corrupted.

I can provide SSH access to an affected system if someone needs to do hands-on troubleshooting.

ProblemType: Bug
DistroRelease: Ubuntu 11.10
Package: linux-image-generic 3.0.0.12.14
ProcVersionSignature: Ubuntu 3.0.0-12.20-generic 3.0.4
Uname: Linux 3.0.0-12-generic x86_64
AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.24.
ApportVersion: 1.23-0ubuntu3
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC0: egable 2620 F.... pulseaudio
CRDA: Error: [Errno 2] No such file or directory
Card0.Amixer.info:
 Card hw:0 'IXP'/'ATI IXP rev 1 with ALC658D at 0xfbdfc800, irq 17'
   Mixer name : 'Realtek ALC658D'
   Components : 'AC97a:414c4781'
   Controls : 38
   Simple ctrls : 24
Card1.Amixer.info:
 Card hw:1 'Modem'/'ATI IXP Modem rev 1 at 0xfbdfcc00, irq 17'
   Mixer name : 'Silicon Laboratory Si3036,8 rev 7'
   Components : 'AC97m:53494c27'
   Controls : 3
   Simple ctrls : 3
Card1.Codecs.codec97.0.mc97.1.1:
 1-1/0: Silicon Laboratory Si3036,8 rev 7

 Extended modem ID: codec=1 LIN1
 Modem status : GPIO MREF ADC1 DAC1 PRE(ADC2) PRF(DAC2) PRG(HADC) PRH(HDAC)
 Line1 rate : 8000Hz
Date: Fri Oct 28 20:09:07 2011
EcryptfsInUse: Yes
InstallationMedia: Ubuntu 11.04 "Natty Narwhal" - Release amd64 (20110427.1)
Lsusb:
 Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
 Bus 002 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
 Bus 003 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
MachineType: MICRO-STAR INT'L CO.,LTD MS-1029
PccardctlIdent:
 Socket 0:
   no product info available
 Socket 1:
   no product info available
PccardctlStatus:
 Socket 0:
   no card
 Socket 1:
   no card
ProcEnviron:
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.0.0-12-generic root=UUID=32d24aba-0be0-4713-9a0f-7b7d734882e5 ro quiet splash vt.handoff=7
RelatedPackageVersions:
 linux-restricted-modules-3.0.0-12-generic N/A
 linux-backports-modules-3.0.0-12-generic N/A
 linux-firmware 1.60
RfKill:
 0: phy0: Wireless LAN
  Soft blocked: no
  Hard blocked: no
SourcePackage: linux
UpgradeStatus: Upgraded to oneiric on 2011-10-22 (6 days ago)
dmi.bios.date: 07/15/2005
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: A1029AE5 V2.30
dmi.chassis.asset.tag: To Be Filled By O.E.M.
dmi.chassis.type: 10
dmi.chassis.vendor: MICRO-STAR INT'L CO.,LTD
dmi.chassis.version: To Be Filled By O.E.M.
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvrA1029AE5V2.30:bd07/15/2005:svnMICRO-STARINT'LCO.,LTD:pnMS-1029:pvr0291:cvnMICRO-STARINT'LCO.,LTD:ct10:cvrToBeFilledByO.E.M.:
dmi.product.name: MS-1029
dmi.product.version: 0291
dmi.sys.vendor: MICRO-STAR INT'L CO.,LTD

Revision history for this message
Eliot Gable (egable) wrote :
Brad Figg (brad-figg)
Changed in linux (Ubuntu):
status: New → Confirmed
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

This does not appear to be a kernel bug. Marking as invalid.

Changed in linux (Ubuntu):
status: Confirmed → Invalid
Revision history for this message
Eliot Gable (egable) wrote :

This is very much a kernel bug. I just installed CentOS 6 inside an LXC container on one of the affected systems and downloads in that container also get corrupted:

Initialized empty Git repository in /usr/local/src/freeswitch/.git/
remote: Counting objects: 174638, done.
remote: Compressing objects: 100% (39940/39940), done.
error: inflate: data stream error (incorrect header check)MiB/s
fatal: pack has bad object at offset 72897475: inflate returned -3
fatal: index-pack failed

Changed in linux (Ubuntu):
status: Invalid → Incomplete
Revision history for this message
Eliot Gable (egable) wrote :
Download full text (4.3 KiB)

Ok, to prove my point, I swapped out the default 11.10 kernel with the CentOS 6 kernel, and Problem Solved.

Welcome to Ubuntu 11.10 (GNU/Linux 2.6.32-71.el6.x86_64 x86_64)

 * Documentation: https://help.ubuntu.com/

  System information as of Sat Nov 19 17:38:55 EST 2011

  System load: 0.0 Processes: 167
  Usage of /: 10.8% of 22.92GB Users logged in: 1
  Memory usage: 2% IP address for br0: 172.16.0.22
  Swap usage: 0% IP address for virbr0: 192.168.122.1

  Graph this data and manage this system at https://landscape.canonical.com/
Last login: Sat Nov 19 17:15:52 2011 from 172.16.0.117
egable@vmhost01:~$ sudo su -
[sudo] password for egable:
root@vmhost01:~$ wget http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
--2011-11-19 17:33:11-- http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
Resolving ftp.osuosl.org... 140.211.166.134
Connecting to ftp.osuosl.org|140.211.166.134|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 149247972 (142M) [application/x-gzip]
Saving to: `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'

100%[==================================================================================================================================================>] 149,247,972 1.23M/s in 54s

2011-11-19 17:34:05 (2.65 MB/s) - `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz' saved [149247972/149247972]

root@vmhost01:~$ sha1sum eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
436d550bfc724f0be3ad8b04e47b831d1b9d2fe4 eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
root@vmhost01:~$ rm -f eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
root@vmhost01:~$ wget http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
--2011-11-19 17:34:13-- http://ftp.osuosl.org/pub/eclipse/technology/epp/downloads/release/indigo/SR1/eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
Resolving ftp.osuosl.org... 140.211.166.134
Connecting to ftp.osuosl.org|140.211.166.134|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 149247972 (142M) [application/x-gzip]
Saving to: `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz'

100%[==================================================================================================================================================>] 149,247,972 4.74M/s in 64s

2011-11-19 17:35:17 (2.24 MB/s) - `eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz' saved [149247972/149247972]

root@vmhost01:~$ sha1sum eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
436d550bfc724f0be3ad8b04e47b831d1b9d2fe4 eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
root@vmhost01:~$ rm -f eclipse-linuxtools-indigo-SR1-incubation-linux-gtk-x86_64.tar.gz
root@vmhost01:~$ wget http://ftp.osuosl.org/pub/...

Read more...

Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
penalvch (penalvch) wrote :

Eliot Gable, thank you for reporting this and helping make Ubuntu better. This bug was reported a while ago and there hasn't been any activity in it recently. We were wondering if this is still an issue? If so, only using the hardware you originally filed the bug under, can you please try with the latest development release of Ubuntu? ISO CD images are available from http://cdimage.ubuntu.com/releases/ .

If it remains an issue, could you run the following command from a Terminal (Applications->Accessories->Terminal). It will automatically gather and attach updated debug information to this report.

apport-collect -p linux <replace-with-bug-number>

Also, if you could test the latest upstream kernel available that would be great. It will allow additional upstream developers to examine the issue. Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text. Please let us know your results.

Thanks in advance.

tags: added: needs-upstream-testing
Changed in linux (Ubuntu):
status: Confirmed → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]

Changed in linux (Ubuntu):
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.