Old debmirrors don't support any of xenial's Translation-* compressions

Bug #1565585 reported by LaMont Jones
40
This bug affects 8 people
Affects Status Importance Assigned to Milestone
debmirror (Ubuntu)
Fix Released
High
William Grant
Trusty
Fix Released
High
William Grant

Bug Description

With xenial dropping the bz2 translations files, trusty's debmirror (1:2.16ubuntu1) fails to mirror any translation files. This then results in the mirror being left in /var/lib/apt/lists/partial, and the mirror being effectively ignored.

[Test Case]

With debmirror 1:2.16ubuntu1:

debmirror --method=http --host=ppa.launchpad.net --root=wgrant/experimental/ubuntu --dist xenial --section=main --arch=amd64 --rsync-extra=none --i18n --verbose --ignore-release-gpg tmp-wgrant-experimental

Verify tmp-wgrant-experimental/dists/xenial/main/i18n/Translation-en.gz does not exist.

Rerun with debmirror 1:2.16ubuntu1.1 and verify that Translation-en.gz now exists.

[Regression Potential]

Old primary archive release pockets only list bz2, so there will be no change in behaviour. But debmirror will now download gz too for post-release pockets and recently changed PPAs, which could conceivably break an untested gzip path in some client. But it's very unlikely, as rsync-based mirrors have had the gz files for weeks.

William Grant (wgrant)
Changed in debmirror (Ubuntu):
status: New → Invalid
summary: - fails to mirror translations, resulting in apt hating the archive
+ Old debmirrors don't fully support all of gz/bzip2/xz
Revision history for this message
William Grant (wgrant) wrote : Re: Old debmirrors don't fully support all of gz/bzip2/xz

trusty's debmirror supports gzip and bzip2 in most places, but will break if gzip disappears for normal indices or bzip2 disappears for Translation-*. Fixing precise and trusty to support bzip2 and xz everywhere is easy, but coping with lack of gzip is probably not worth it.

Revision history for this message
William Grant (wgrant) wrote :

precise just downloads everything mentioned in i18n/Index, so it actually already generates a functional archive.

The lowest impact fix for trusty is to mirror Translation-*.gz as well. xenial's apt falls straight back from xz to gz for Packages/Sources/Translation-*, so it works fine even without full xz support.

summary: - Old debmirrors don't fully support all of gz/bzip2/xz
+ Old debmirrors don't support any of xenial's Translation-* compressions
no longer affects: debmirror (Ubuntu Precise)
Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in debmirror (Ubuntu Trusty):
status: New → Confirmed
Revision history for this message
Maik Zumstrull (m-zumstrull) wrote :

Is it intentional that this is set Invalid and therefore hidden in the bug overview? That's pretty much why I accidentally duped it.

Revision history for this message
Colin Watson (cjwatson) wrote :

The default-series task is Invalid (should actually be Fix Released - changed) since it's already fixed in xenial. The trusty task is open.

Changed in debmirror (Ubuntu):
status: Invalid → Fix Released
William Grant (wgrant)
Changed in debmirror (Ubuntu Trusty):
assignee: nobody → William Grant (wgrant)
status: Confirmed → In Progress
William Grant (wgrant)
description: updated
description: updated
Revision history for this message
Rick Sherman (shermdog) wrote :

The guidance from #1565751 appears to correct the issue.

Revision history for this message
Rick Sherman (shermdog) wrote :
Revision history for this message
Adam Conrad (adconrad) wrote : Please test proposed package

Hello LaMont, or anyone else affected,

Accepted debmirror into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/debmirror/1:2.16ubuntu1.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in debmirror (Ubuntu Trusty):
status: In Progress → Fix Committed
tags: added: verification-needed
Revision history for this message
William Grant (wgrant) wrote :

Turns out I was looking at the dep11 bits of xenial's debmirror, not the i18n function. 1:2.25ubuntu1 has the same issue.

Changed in debmirror (Ubuntu):
status: Fix Released → Triaged
assignee: nobody → William Grant (wgrant)
status: Triaged → In Progress
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package debmirror - 1:2.25ubuntu2

---------------
debmirror (1:2.25ubuntu2) xenial; urgency=medium

  * Download Translation-*.gz/xz in addition to Translation-*.bz2. Launchpad
    replaces bz2 with xz from xenial. (LP: #1565585)

 -- William Grant <email address hidden> Tue, 05 Apr 2016 15:17:59 +1000

Changed in debmirror (Ubuntu):
status: In Progress → Fix Released
Revision history for this message
Roman Fiedler (roman-fiedler-deactivatedaccount) wrote :

Package installed on our package mirror, fixes the bug and allows to mirror Xenial from here on. (Mirror already filled, working).

Mathew Hodson (mhodson)
Changed in debmirror (Ubuntu):
importance: Undecided → High
Changed in debmirror (Ubuntu Trusty):
importance: Undecided → High
Revision history for this message
Adam Conrad (adconrad) wrote :

Marking v-done based on comment 11.

tags: added: verification-done
removed: verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package debmirror - 1:2.16ubuntu1.1

---------------
debmirror (1:2.16ubuntu1.1) trusty; urgency=medium

  * Download Translation-*.gz in addition to Translation-*.bz2. Launchpad
    replaces bz2 with xz from xenial. (LP: #1565585)

 -- William Grant <email address hidden> Mon, 04 Apr 2016 14:56:40 +1000

Changed in debmirror (Ubuntu Trusty):
status: Fix Committed → Fix Released
Revision history for this message
Adam Conrad (adconrad) wrote : Update Released

The verification of the Stable Release Update for debmirror has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.