If u-r-c tries and fails to update it breaks local metadata service on the leader

Bug #1672940 reported by David Lawson
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ubuntu Repository Cache Charm
Fix Released
Undecided
Unassigned
ubuntu-repository-cache (Juju Charms Collection)
Fix Released
High
Chris Glass

Bug Description

If the u-r-c charm tries and fails to update from a mirror that, for example, has an in progress update, the resulting failure mode trashes the local metadata mirror symlink and breaks local service. I believe in this case it should fall back to serving from a peer but, for some reason, it's not doing that either.

https://pastebin.canonical.com/182533/

In the paste, I've manipulated /srv/ubuntu-repository-cache/ephemeral/0/apache/data/ so that it is functional and matches the working peer, then initiated a sync, which fails because of an update in progress. In the ls at the end, the ubuntu_active symlink is broken, pointing to a directory that doesn't exist.

Revision history for this message
David Lawson (deej) wrote :

This same failure mode occurs if the u-r-c leader tries to update from a slow mirror and the rsync times out.

Revision history for this message
Dan Watkins (oddbloke) wrote :

Hey deej,

Thanks for filing this, we'll start looking at it ASAP. One thing we were curious about is why we only just started seeing this failure case. Is this the first time you're deploying a more recent version of the charm, or is there some other difference?

Thanks,

Dan

Revision history for this message
David Lawson (deej) wrote :

Yeah, I believe this is the first time we've deployed a relatively recent version of the charm, I'm not sure when the last time we turned up a new region in one of the clouds was, but I know the AWS mirrors are running older versions of the charm.

Chris Glass (tribaal)
Changed in ubuntu-repository-cache (Juju Charms Collection):
assignee: nobody → Chris Glass (tribaal)
status: New → In Progress
Chris Glass (tribaal)
Changed in ubuntu-repository-cache (Juju Charms Collection):
importance: Undecided → High
Chris Glass (tribaal)
Changed in ubuntu-repository-cache:
status: New → Fix Committed
Changed in ubuntu-repository-cache (Juju Charms Collection):
status: In Progress → Fix Committed
tags: added: id-58c98d45da2ec3a1c4c3b96f
Haw Loeung (hloeung)
Changed in ubuntu-repository-cache:
status: Fix Committed → Fix Released
Changed in ubuntu-repository-cache (Juju Charms Collection):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.