wget 1.19.4 corrupts large downloaded files

[Tony Travis]

In normal use, downloading small files, "wget" 1.19.4 works correctly under Ubuntu-MATE 18.04 LTS. The length and md5sums of downloaded files are correct. However, when attempting to download a larger 16GB .tar.gz file the length of the original file on the server is 16336802611 bytes, but the downloaded file is 16463139667 bytes and the computed md5sum of the file does not match the stored md5sum of the file on the server:

ionice -c idle wget --no-check-certificate ftp://ftp.ncbi.nih.gov/snp/organisms/human_9606_b151_GRCh38p7/VCF/All_20180418.vcf.gz
--2021-03-23 16:22:12-- ftp://ftp.ncbi.nih.gov/snp/organisms/human_9606_b151_GRCh38p7/VCF/All_20180418.vcf.gz
           => ‘All_20180418.vcf.gz’
Resolving ftp.ncbi.nih.gov (ftp.ncbi.nih.gov)... 130.14.250.11, 130.14.250.13, 2607:f220:41e:250::11, ...
Connecting to ftp.ncbi.nih.gov (ftp.ncbi.nih.gov)|130.14.250.11|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD (1) /snp/organisms/human_9606_b151_GRCh38p7/VCF ... done.
==> SIZE All_20180418.vcf.gz ... 16336802611
==> PASV ... done. ==> RETR All_20180418.vcf.gz ... done.
Length: 16336802611 (15G) (unauthoritative)

All_20180418.vcf.gz 100%[================================================================================================================>] 15.33G 939KB/s in 2h 7m

2021-03-23 18:29:25 (2.06 MB/s) - ‘All_20180418.vcf.gz’ saved [16463139667]

Repeating the same download using "wget" 1.20.3 under Ubuntu-MATE 20.04 LTS, the file length and md5sum are correct.

ProblemType: Bug
DistroRelease: Ubuntu 18.04
Package: wget 1.19.4-1ubuntu2.2
ProcVersionSignature: Ubuntu 5.4.0-66.74~18.04.2-generic 5.4.86
Uname: Linux 5.4.0-66-generic x86_64
NonfreeKernelModules: zfs zunicode zavl icp zcommon znvpair nvidia_modeset nvidia
ApportVersion: 2.20.9-0ubuntu7.23
Architecture: amd64
Date: Wed Mar 24 02:32:49 2021
InstallationDate: Installed on 2020-08-03 (232 days ago)
InstallationMedia: Ubuntu-MATE 20.04 LTS "Focal Fossa" - Release amd64 (20200423)
ProcEnviron:
 LANGUAGE=en_GB:en
 TERM=xterm-256color
 PATH=(custom, no user)
 LANG=en_GB.UTF-8
 SHELL=/bin/bash
SourcePackage: wget
UpgradeStatus: No upgrade log present (probably fresh install)

[Tony Travis (ajtravis)]

Please note: I ran "ubuntu-bug" on the system running "wget" 1.19.4 under Ubuntu-MATE 18.04 LTS, but I reported the bug using Firefox running under Ubuntu-MATE 20.04 LTS

[Tony Travis (ajtravis)]

Changing the URL from ftp:// to http:// allowed me to download the file successfully:
wget http://ftp.ncbi.nih.gov/snp/organisms/human_9606_b151_GRCh38p7/VCF/All_20180418.vcf.gz