release upgrade for EOL releases fails

[Wesley Schwengle]

Hello,

I'm upgrading a laptop of mine, which still is running on 6.10. The end goal is to get the laptop to the latest version, however, it fails with the upgrade to 7.04.

According to the wiki page (https://help.ubuntu.com/community/FeistyUpgrades) do-release should to the trick, however it fails because it tries to download from archive.ubuntu.com for edgy, while its located at old-releases.ubuntu.com...

I've located the origin of the problem in DistUpgradeControler.py (line 351):

            # special case for old-releases.ubuntu.com, auto transition
            # them back to archive.ubuntu.com - now this is a problem
            # of course for people upgrading from EOL release to a
            # EOL release
            if (not entry.disabled and
                entry.uri.startswith("http://old-releases.ubuntu.com/ubuntu")):
                entry.uri = "http://archive.ubuntu.com/ubuntu"
                logging.debug("transitioning old-releases.ubuntu.com to '%s' " % entry)
                continue

This basically causes downloads from incorrect repositories.

sources.list before upgrade:
deb http://old-releases.ubuntu.com/ubuntu/ edgy main restricted
deb-src http://old-releases.ubuntu.com/ubuntu/ edgy main restricted
deb http://old-releases.ubuntu.com/ubuntu/ edgy-updates main restricted
deb-src http://old-releases.ubuntu.com/ubuntu/ edgy-updates main restricted
deb http://old-releases.ubuntu.com/ubuntu/ edgy universe multiverse
deb-src http://old-releases.ubuntu.com/ubuntu/ edgy universe multiverse
deb http://old-releases.ubuntu.com/ubuntu edgy-security main restricted
deb-src http://old-releases.ubuntu.com/ubuntu edgy-security main restricted

Changes to during the upgrade:

deb http://archive.ubuntu.com/ubuntu edgy main restricted
deb-src http://archive.ubuntu.com/ubuntu edgy main restricted
deb http://archive.ubuntu.com/ubuntu edgy-updates main restricted
deb-src http://archive.ubuntu.com/ubuntu edgy-updates main restricted
deb http://archive.ubuntu.com/ubuntu edgy universe multiverse
deb-src http://archive.ubuntu.com/ubuntu edgy universe multiverse
deb http://archive.ubuntu.com/ubuntu edgy-security main restricted
deb http://archive.ubuntu.com/ubuntu feisty main restricted
deb http://archive.ubuntu.com/ubuntu feisty-updates main restricted
deb http://security.ubuntu.com/ubuntu/ feisty-security main restricted
deb-src http://archive.ubuntu.com/ubuntu edgy-security main restricted

And then the download fails.

Error during update
A problem occured during the update. This is usually some sort of network problem, please check your network connection and retry.
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/main/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/restricted/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/main/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/restricted/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/universe/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/multiverse/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/universe/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/multiverse/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-updates/main/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-updates/restricted/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-updates/main/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-updates/restricted/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-security/main/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-security/restricted/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-security/main/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]
Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy-security/restricted/source/Sources.gz 404 Not Found [IP: 91.189.88.31 80]

/var/log/dist-upgrade/main.log
2008-09-03 03:34:18,284 INFO release-upgrader version '0.59.22' started
2008-09-03 03:34:18,561 DEBUG lsb-release: 'edgy'
2008-09-03 03:34:18,561 DEBUG _pythonSymlinkCheck run
2008-09-03 03:34:44,220 DEBUG Foreign:
2008-09-03 03:34:44,220 DEBUG Obsolete: gimp-svg xpdf-common xpdf-utils xpdf-reader xpdf mkisofs vlc mozilla-plugin-vlc git-fvcs vim-gtk cdrecord kde-icons-nuvox vim-perl libiso9660-4 qt3-dev-tools-compat qt3-dev-tools-embedded vlc-nox libvlc0
2008-09-03 03:34:44,247 DEBUG updateSourcesList()
2008-09-03 03:34:44,356 DEBUG rewriteSourcesList()
2008-09-03 03:34:44,359 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy main restricted'
2008-09-03 03:34:44,359 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy main restricted'
2008-09-03 03:34:44,359 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy-updates main restricted'
2008-09-03 03:34:44,359 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy-updates main restricted'
2008-09-03 03:34:44,359 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy universe multiverse'
2008-09-03 03:34:44,360 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy universe multiverse'
2008-09-03 03:34:44,360 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy-security main restricted'
2008-09-03 03:34:44,360 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy-security main restricted'
2008-09-03 03:34:44,360 ERROR No valid mirror found
2008-09-03 03:34:47,094 DEBUG rewriteSourcesList()
2008-09-03 03:34:47,095 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy main restricted'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy main restricted'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy-updates main restricted'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy-updates main restricted'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy universe multiverse'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy universe multiverse'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb http://archive.ubuntu.com/ubuntu edgy-security main restricted'
2008-09-03 03:34:47,096 DEBUG transitioning old-releases.ubuntu.com to 'deb-src http://archive.ubuntu.com/ubuntu edgy-security main restricted'
2008-09-03 03:35:03,493 ERROR IOError in cache.update(): 'Failed to fetch http://archive.ubuntu.com/ubuntu/dists/edgy/main/binary-i386/Packages.gz 404 Not Found [IP: 91.189.88.46 80]

I guess this behavior is present for all EOL distributions.

When restarting the upgrade proces (via /tmp/tmpxxxx/feisty --frontend DistUpgradeViewText --mode=server) with only the feisty repo's in the sources.list file it will start the upgrade process as expected.

[Michael Vogt (mvo)]

Thanks, this is a problem indeed. Here are the steps in order to solve this problem once and for all:

 * the release upgrader magic tarball moves from releases.u.c to
   old-releases.u.c - we can deal with that easily via the
   meta-release file on changelogs.ubuntu.com that we can
   control/update anytime
 * the upgrader does not know that old-releases.u.c is a
   valid mirrors - fixed in bzr
 * the upgrader must deal with the situation that a EOL release may
   still point to archive.u.c but just gets 404 from it
 * if the EOL release got pointed to old-releases.u.c it must rewrite
   the sources.list to:
   * archive.u.c if the upgrade goes to a supported release
   * old-releases.u.c if the upgrades goes to a EOL release
      (think edyy->feisty->gutsy where e->f will need this magic)

This means we need to sync the EOL process with copying the data to
old-releases.u.c - I will write a mail to the sysadmin team about it.

[Launchpad Janitor (janitor)]

This bug was fixed in the package update-manager - 1:0.96.1

---------------
update-manager (1:0.96.1) jaunty; urgency=low

  * DistUpgrade/DistUpgradeController.py:
    - deal better with upgrades from EOL releases by
      testing if the new release is on the country mirror
      or archive.ubuntu.com or still on old-releases.ubuntu.com
      (LP: #264181)
  * debian/control:
    - disable the auto-upgrader-tester package, its not quite
      ready yet

 -- Michael Vogt <email address hidden> Tue, 13 Jan 2009 14:52:18 +0100

[Brolin Empey (brolin.empey)]

How do I get this fix for Ubuntu 6.10? The highest available version of update-manager is 0.45.2. I want to upgrade from Ubuntu 6.10 to 7.04 to 7.10 to 8.04.1 LTS.

[Wesley Schwengle (wesleys)]

Brolin,

Follow the instructions on the page I mentioned in the bug report: https://help.ubuntu.com/community/FeistyUpgrades

Run `sudo do-release-upgrade' once, you will need to download some files from the old repo, and then you will encounter 404 errors.

Then you need to make sure you get a sources.list with only feisty repo's in it:

deb http://archive.ubuntu.com/ubuntu feisty main restricted
deb http://archive.ubuntu.com/ubuntu feisty-updates main restricted
deb http://security.ubuntu.com/ubuntu/ feisty-security main restricted

Now you should continue the upgrade process via `/tmp/tmpxxxx/feisty --frontend DistUpgradeViewText --mode=server'.
This will update your 6.10 to 7.04

tmpxxxx is different for every do-release-upgrade run, you could run `find /tmp -name feisty' to find out where the file is located.

It is a bit more work, but it will upgrade your box without problems.

Good luck!

[Brolin Empey (brolin.empey)]

2009/1/18 Wesley <email address hidden>

> Brolin,
>
> Follow the instructions on the page I mentioned in the bug report:
> https://help.ubuntu.com/community/FeistyUpgrades
>
> Run `sudo do-release-upgrade' once, you will need to download some files
> from the old repo, and then you will encounter 404 errors.
>

My mistake: I was following the Kubuntu instructions instead of the CLI
instructions. I will try upgrading again next weekend.

--
Sometimes I forget how to do small talk: <http://xkcd.com/222/>

"What if there were no hypothetical questions?" — George Carlin

[Wesley Schwengle (wesleys)]

Micheal, as I was helping Brolin I discovered that the upgrade path from 7.04 to 7.10 is different: https://help.ubuntu.com/community/EOLUpgrades

There is no rewrite from old-releases to archive. It is easy to fix, but I was a bit confused by this at first.

[Brolin Empey (brolin.empey)]

Thanks to Wesley, I have successfully upgraded oberon, the PC serving opentaps at my work, from Ubuntu 6.10 to 7.04 to 7.10 to 8.04.2 LTS over this weekend. opentaps still seems to work after each upgrade. :)

[mjern92 (mjern92)]

I believe I am encountering the same issue with an upgrade from 7.10 to 8.04 now that 7.10 has reached EOL. It looks for the gutsy files in archive.ubuntu.com instead of old-releases.