debmirror messes up the mirroring process

Bug #1711429 reported by dienteperro
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
debmirror (Ubuntu)
Confirmed
Undecided
Unassigned

Bug Description

I have been mirroring precise and xenial repos for my local networks for several months (or even years). Recently (perhaps due to EoL of precise) debmirror is showing errors during the fetch of files and does not download the updates. So the workstations been fed by my local mirror show 0 updates available, but when update from internet repo show several updates. I reproduce here my debmirror file and the output with the errors. The mirroring system details are:

lsb_release -rd
Description: Ubuntu 16.04.3 LTS
Release: 16.04

amd64 system

apt-cache policy debmirror
debmirror:
  Installed: 1:2.25ubuntu2
  Candidate: 1:2.25ubuntu2
  Version table:
 *** 1:2.25ubuntu2 500
        500 http://us.archive.ubuntu.com/ubuntu xenial/universe amd64 Packages
        500 http://us.archive.ubuntu.com/ubuntu xenial/universe i386 Packages
        100 /var/lib/dpkg/status

The expected behavior is that debmirror correctly mirrors the repos from the internet to my local network.

What is happening now is that the files are not downloaded and an error is shown in the process.

My debmirror script (ran every night):
#### Start script to automate building of Ubuntu mirror #####
## THE NEXT LINE IS NEEDED THE REST OF THE LINES STARTING WITH A # CAN BE DELETED

#!/bin/bash

## Setting variables with explanations.

#
# Don't touch the user's keyring, have our own instead
#
export GNUPGHOME=/home/mirrorkeyring

# Arch= -a # Architecture. For Ubuntu can be i386, powerpc or amd64.
# sparc, only starts in dapper, it is only the later models of sparc.
#
arch=i386,amd64

# Minimum Ubuntu system requires main, restricted
# Section= -s # Section (One of the following - main/restricted/universe/multiverse).
# You can add extra file with $Section/debian-installer. ex: main/debian-installer,universe/debian-installer,multiverse/debian-installer,restricted/debian-installer
#
section=main,restricted,universe,multiverse

# Release= -d # Release of the system (...Hardy, Intrepid... Lucid, Precise, Quantal, Saucy, Trusty ), and the -updates and -security ( -backports can be added if desired)
# List of updated releases in: https://wiki.ubuntu.com/Releases
#

release=precise,precise-updates,precise-backports,precise-proposed,xenial,xenial-updates,xenial-backports,xenial-proposed

# Server= -h # Server name, minus the protocol and the path at the end
# CHANGE "*" to equal the mirror you want to create your mirror from. au. in Australia ca. in Canada.
# This can be found in your own /etc/apt/sources.list file, assuming you have Ubuntu installed.
#
server=us.archive.ubuntu.com

# Dir= -r # Path from the main server, so http://my.web.server/$dir, Server dependant
#
inPath=/ubuntu

# Proto= --method= # Protocol to use for transfer (http, ftp, hftp, rsync)
# Choose one - http is most usual the service, and the service must be avaialbe on the server you point at.
#
proto=http

# Outpath= # Directory to store the mirror in
# Make this a full path to where you want to mirror the material.
#
outPath=/data/repo/ubuntu

# The --nosource option only downloads debs and not deb-src's
# The --progress option shows files as they are downloaded
# --source \ in the place of --no-source \ if you want sources also.
# --nocleanup Do not clean up the local mirror after mirroring is complete. Use this option to keep older repository
# Start script
#
debmirror -a $arch \
                --no-source \
                -s $section \
                -h $server \
                -d $release \
                -r $inPath \
                --progress \
                --method=$proto \
                $outPath

#### End script to automate building of Ubuntu mirror ####

Now the output (and errors) during the mirroring process:
Mirroring to /data/repo/ubuntu from http://us.archive.ubuntu.com/ubuntu/
Arches: i386,amd64
Dists: precise,precise-updates,precise-backports,precise-proposed,xenial,xenial-updates,xenial-backports,xenial-proposed
Sections: main,restricted,universe,multiverse
Pdiff mode: use
Will clean up after mirroring.
Attempting to get lock ...
Updating remote trace files (using rsync) ...
receiving incremental file list
./
project/trace/pepo.canonical.com
             29 100% 28.32kB/s 0:00:00 (xfr#1, to-chk=4/11)
project/trace/wahoo.canonical.com
             29 100% 0.27kB/s 0:00:00 (xfr#2, to-chk=1/11)
project/trace/wahoo.canonical.com.dists-timestamps
        309,045 100% 164.92kB/s 0:00:01 (xfr#3, to-chk=0/11)
Getting meta files ...
[ 0%] Getting: dists/precise/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise/Release ==> 200 OK (2s)
ok
[ 0%] Getting: dists/precise/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise/InRelease ==> 404 Not Found
failed 404 Not Found
[ 0%] Getting: dists/precise/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise/Release.gpg ==> 200 OK
ok
Ubuntu Release file: using Suite (precise).
[ 0%] Getting: dists/precise-updates/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-updates/Release ==> 200 OK (15s)
ok
[ 0%] Getting: dists/precise-updates/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-updates/InRelease ==> 200 OK (1s)
ok
[ 0%] Getting: dists/precise-updates/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-updates/Release.gpg ==> 200 OK
ok
Ubuntu Release file: using Suite (precise-updates).
[ 0%] Getting: dists/precise-backports/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-backports/Release ==> 200 OK (1s)
ok
[ 0%] Getting: dists/precise-backports/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-backports/InRelease ==> 200 OK (1s)
ok
[ 0%] Getting: dists/precise-backports/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-backports/Release.gpg ==> 200 OK (2s)
ok
Ubuntu Release file: using Suite (precise-backports).
[ 0%] Getting: dists/precise-proposed/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-proposed/Release ==> 200 OK (1s)
ok
[ 0%] Getting: dists/precise-proposed/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-proposed/InRelease ==> 200 OK (1s)
ok
[ 0%] Getting: dists/precise-proposed/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/precise-proposed/Release.gpg ==> 200 OK (1s)
ok
Ubuntu Release file: using Suite (precise-proposed).
[ 0%] Getting: dists/xenial/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial/Release ==> 200 OK (3s)
ok
[ 0%] Getting: dists/xenial/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial/InRelease ==> 200 OK (13s)
ok
[ 0%] Getting: dists/xenial/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial/Release.gpg ==> 200 OK (1s)
ok
Ubuntu Release file: using Suite (xenial).
[ 0%] Getting: dists/xenial-updates/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-updates/Release ==> 200 OK (2s)
ok
[ 0%] Getting: dists/xenial-updates/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-updates/InRelease ==> 200 OK (6s)
ok
[ 0%] Getting: dists/xenial-updates/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-updates/Release.gpg ==> 200 OK (1s)
ok
Ubuntu Release file: using Suite (xenial-updates).
[ 0%] Getting: dists/xenial-backports/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-backports/Release ==> 200 OK (1s)
ok
[ 0%] Getting: dists/xenial-backports/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-backports/InRelease ==> 200 OK (2s)
ok
[ 0%] Getting: dists/xenial-backports/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-backports/Release.gpg ==> 200 OK
ok
Ubuntu Release file: using Suite (xenial-backports).
[ 0%] Getting: dists/xenial-proposed/Release... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/Release ==> 200 OK (6s)
ok
[ 0%] Getting: dists/xenial-proposed/InRelease... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/InRelease ==> 200 OK (5s)
ok
[ 0%] Getting: dists/xenial-proposed/Release.gpg... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/Release.gpg ==> 200 OK (1s)
ok
Ubuntu Release file: using Suite (xenial-proposed).
[ 53%] Getting: dists/xenial-proposed/main/binary-i386/Packages.xz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/main/binary-i386/Packages.xz ==> 200 OK
ok
[ 54%] Getting: dists/xenial-proposed/main/binary-i386/Packages.gz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/main/binary-i386/Packages.gz ==> 200 OK (2s)
ok
[ 54%] Getting: dists/xenial-proposed/main/binary-amd64/Packages.xz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/main/binary-amd64/Packages.xz ==> 200 OK (2s)
ok
[ 54%] Getting: dists/xenial-proposed/main/binary-amd64/Packages.gz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/main/binary-amd64/Packages.gz ==> 200 OK (3s)
ok
[ 54%] Getting: dists/xenial-proposed/universe/binary-i386/Packages.xz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/universe/binary-i386/Packages.xz ==> 200 OK (1s)
ok
[ 54%] Getting: dists/xenial-proposed/universe/binary-i386/Packages.gz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/universe/binary-i386/Packages.gz ==> 200 OK
ok
[ 54%] Getting: dists/xenial-proposed/universe/binary-amd64/Packages.xz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/universe/binary-amd64/Packages.xz ==> 200 OK (1s)
ok
[ 54%] Getting: dists/xenial-proposed/universe/binary-amd64/Packages.gz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-proposed/universe/binary-amd64/Packages.gz ==> 200 OK
ok
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
Use of uninitialized value $size in numeric eq (==) at /usr/bin/debmirror line 1645.
[ 92%] Getting: dists/xenial-updates/main/binary-i386/Packages.xz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-updates/main/binary-i386/Packages.xz ==> 200 OK (157s)
ok
[ 93%] Getting: dists/xenial-updates/main/binary-i386/Packages.gz... #** GET http://us.archive.ubuntu.com/ubuntu/dists/xenial-updates/main/binary-i386/Packages.gz ==> 200 OK (518s)
read timeout at /usr/share/perl5/Net/HTTP/Methods.pm line 248. at /usr/share/perl5/LWP/UserAgent.pm line 916.
WARNING: releasing 1 pending lock...

description: updated
Revision history for this message
Jamie Strandboge (jdstrand) wrote :

I believe this is a duplicate of bug #1578662, which has a patch (I've been using https://launchpadlibrarian.net/279275413/debmirror.deb.patch).

Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in debmirror (Ubuntu):
status: New → Confirmed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.