Contents files are not listed with checksums

Bug #638498 reported by Jason Cline
50
This bug affects 8 people
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
Low
Colin Watson
debmirror (Ubuntu)
Confirmed
Undecided
Unassigned

Bug Description

Binary package hint: debmirror

debmirror 1:2.4.4ubuntu2 from lucid lynx appears to ignore --getcontents.

debmirror's --getcontents option appears to do nothing. --diff=use,none,mirror appear to have no effect on the outcome either. I was expecting Contents-<arch>.gz files in every dist's directory, none of which materialized until I went back to 20070123ubuntu1.

I did some troubleshooting, and found that even forcing add_bytes in the if ($getcontents) block appears to be ignored.

---snip including my added debug output--
Get Packages and Sources files and other miscellany.
dists/dapper/Contents-amd64.gz
dists/dapper/Contents-i386.gz
dists/dapper-proposed/Contents-amd64.gz
dists/dapper-proposed/Contents-i386.gz
dists/dapper-updates/Contents-amd64.gz
dists/dapper-updates/Contents-i386.gz
dists/dapper-security/Contents-amd64.gz
dists/dapper-security/Contents-i386.gz
dists/dapper-backports/Contents-amd64.gz
dists/dapper-backports/Contents-i386.gz
dists/hardy/Contents-amd64.gz
dists/hardy/Contents-i386.gz
dists/hardy-proposed/Contents-amd64.gz
dists/hardy-proposed/Contents-i386.gz
dists/hardy-updates/Contents-amd64.gz
dists/hardy-updates/Contents-i386.gz
dists/hardy-security/Contents-amd64.gz
dists/hardy-security/Contents-i386.gz
dists/hardy-backports/Contents-amd64.gz
dists/hardy-backports/Contents-i386.gz
dists/lucid/Contents-amd64.gz
dists/lucid/Contents-i386.gz
dists/lucid-proposed/Contents-amd64.gz
dists/lucid-proposed/Contents-i386.gz
dists/lucid-updates/Contents-amd64.gz
dists/lucid-updates/Contents-i386.gz
dists/lucid-security/Contents-amd64.gz
dists/lucid-security/Contents-i386.gz
dists/lucid-backports/Contents-amd64.gz
dists/lucid-backports/Contents-i386.gz
Parse Packages and Sources files and add to the file list everything therein.
Download all files that we need to get (0 B).
--snip--

Related branches

Changed in debmirror (Ubuntu):
status: New → Confirmed
cmezh (dmovodov)
Changed in debmirror (Ubuntu):
status: Confirmed → New
Revision history for this message
Tim Edwards (tkedwards) wrote :

I can confirm that this bug is still present in 11.10.

After running debmirror with --getcontents I get:

sudo apt-file update
cp: cannot stat `//home/files/packages/ubuntu/dists/oneiric/Contents-amd64.gz': No such file or directory
cp: cannot stat `//home/files/packages/ubuntu/dists/oneiric-updates/Contents-amd64.gz': No such file or directory
cp: cannot stat `//home/files/packages/ubuntu/dists/oneiric-security/Contents-amd64.gz': No such file or directory

Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in debmirror (Ubuntu):
status: New → Confirmed
Revision history for this message
Patrick Banholzer (patrick-banholzer) wrote :

I can confirm this ... we have the same issue here!

Revision history for this message
Steve Atwell (satwell) wrote :

This actually appears to be a problem with the Ubuntu archive, not debmirror. The Release files in the Ubuntu archive are missing hashes for the Contents-* files. E.g., see:

http://archive.ubuntu.com/ubuntu/dists/precise/Release

Compare this to a Debian archive's Release file, which *does* list the Contents-* files:

http://archive.debian.org/debian/dists/lenny/Release

I think there's a minor bug here where debmirror should be complaining that it can't find Contents files rather than silently dropping them, but the underlying problem seems to be with the Ubuntu archive.

Revision history for this message
Tim Edwards (tkedwards) wrote :

I've emailed <email address hidden> as that's listed as the way to report problems with the mirrors. I'll post here if I get a response from them.

Revision history for this message
LaMont Jones (lamont) wrote :

Launchpad generates the contents files, making this bug in launchpad

affects: debmirror (Ubuntu) → launchpad
Changed in launchpad:
status: Confirmed → New
Changed in debmirror (Ubuntu):
status: New → Confirmed
summary: - debmirror ignores --getcontents
+ Contents files are not listed with checksums
Changed in launchpad:
status: New → Triaged
importance: Undecided → Critical
William Grant (wgrant)
Changed in launchpad:
importance: Critical → Low
William Grant (wgrant)
tags: added: soyuz-publish
Revision history for this message
Patrick Banholzer (patrick-banholzer) wrote :

can anybody give us an update on this bug?

Revision history for this message
Tong Sun (suntong001) wrote :

> can anybody give us an update on this bug?
+1!

I'm building Debian source packages from Perl modules with dh-make-perl, which relies on apt-file for dependencies checking. However,

apt-file update says:

Ignoring source without Contents File:
  http://ppa.launchpad.net/suntong001/ppa/ubuntu/dists/saucy/Contents-amd64.gz

I.e., dh-make-perl dependencies checking for my Perl modules will *always fail*, even I have the dependencies modules in my PPA.

Changed in launchpad:
status: Triaged → Confirmed
Revision history for this message
William Grant (wgrant) wrote :

Tong Sun, that's bug #335161.

Changed in launchpad:
status: Confirmed → Triaged
Revision history for this message
Manuel Vazquez Acosta (mva-led) wrote :

So... Is anyone solving this issue?

Last comment is five months old.

Revision history for this message
William Grant (wgrant) wrote :

It's not currently on our roadmap to fix, but Launchpad's open source and we'd be happy to mentor someone to fix it themselves. See https://dev.launchpad.net/ to get started with development.

Colin Watson (cjwatson)
Changed in launchpad:
assignee: nobody → Colin Watson (cjwatson)
status: Triaged → In Progress
Revision history for this message
Colin Watson (cjwatson) wrote :

This is not quite entirely as trivial as it first looks. Firstly, we need to make sure to put Contents in place before publishing the rest of the archive, rather than the other way round as is done today. Secondly, we need to ensure that if any of a pocket's Contents files have changed then the pocket is marked dirty and hence has its Release file rewritten, which is not straightforwardly the case today. There may be a couple of other subtleties I've missed.

Revision history for this message
Launchpad QA Bot (lpqabot) wrote :
tags: added: qa-needstesting
Changed in launchpad:
status: In Progress → Fix Committed
Revision history for this message
Colin Watson (cjwatson) wrote :

Note that this fix will take effect from vivid onwards (well, and for non-release suites such as -updates), unless we have some pressing reason to regenerate the Release files for stable releases. To date, we've only done that when we've had to remove packages due to pressing legal reasons.

tags: added: qa-ok
removed: qa-needstesting
Colin Watson (cjwatson)
Changed in launchpad:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers