Uploads fail due to starvation

Bug #767466 reported by Lucio Torre
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ubuntu One Client
Status tracked in Trunk
Stable-1-6
Fix Released
Critical
Facundo Batista
Trunk
Fix Released
Critical
Facundo Batista
Ubuntu One storage protocol
Status tracked in Trunk
Stable-1-6
Fix Released
Critical
Facundo Batista
Trunk
Fix Released
Critical
Facundo Batista
ubuntuone-client (Ubuntu)
Fix Released
Critical
dobey
Natty
Fix Released
Critical
dobey
Oneiric
Fix Released
Undecided
Unassigned
ubuntuone-storage-protocol (Ubuntu)
Fix Released
Critical
dobey
Natty
Fix Released
Critical
dobey
Oneiric
Fix Released
Undecided
Unassigned

Bug Description

When uploading files with a slow uplink and using the current payload size we dont write to each transfer often enough to avoid s3 starvation. We need to write more often from each of the current transfers and the way to do it is to have a smaller payload size. We write less but more often, as required to avoid starvation.

---

TEST CASE:
Need an Ubuntu One account setup and a slow uplink to test this properly.
1. Copy 25 files at least 2 MB in size into the ~/Ubuntu One folder
2. Allow files to sync

Expected result: Files upload properly rather than never uploading and showing TRY_AGAIN repeatedly in the ~/.cache/ubuntuone/log/syncdaemon.log

Related branches

Changed in ubuntuone-client:
importance: Undecided → Critical
status: New → Triaged
assignee: nobody → Facundo Batista (facundo)
Changed in ubuntuone-storage-protocol:
status: New → Triaged
importance: Undecided → Critical
assignee: nobody → Facundo Batista (facundo)
Changed in ubuntuone-storage-protocol:
status: Triaged → In Progress
Changed in ubuntuone-client:
status: Triaged → In Progress
Changed in ubuntuone-storage-protocol:
status: In Progress → Fix Committed
Changed in ubuntuone-client:
status: In Progress → Fix Committed
dobey (dobey)
Changed in ubuntuone-client (Ubuntu Natty):
assignee: nobody → Rodney Dawes (dobey)
importance: Undecided → Critical
status: New → In Progress
Changed in ubuntuone-storage-protocol (Ubuntu Natty):
assignee: nobody → Rodney Dawes (dobey)
importance: Undecided → Critical
status: New → In Progress
Revision history for this message
Clint Byrum (clint-fewbar) wrote : Please test proposed package

Accepted ubuntuone-storage-protocol into natty-proposed, the package will build now and be available in a few hours. Please test and give feedback here. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you in advance!

Changed in ubuntuone-storage-protocol (Ubuntu Natty):
status: In Progress → Fix Committed
tags: added: verification-needed
Revision history for this message
Clint Byrum (clint-fewbar) wrote :

I see where the patch adds some test code. I wonder if you can spell out exactly how to test that this is fixed in case those outside u1 development would like to verify the fix.

Revision history for this message
Clint Byrum (clint-fewbar) wrote :

Accepted ubuntuone-client into natty-proposed, the package will build now and be available in a few hours. Please test and give feedback here. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you in advance!

Changed in ubuntuone-client (Ubuntu Natty):
status: In Progress → Fix Committed
description: updated
Revision history for this message
Joshua Hoover (joshuahoover) wrote :

Test passed with ubuntuone-client 1.6.2-0ubuntu1

tags: added: u1-natty-sru verification-done
removed: verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package ubuntuone-client - 1.6.2-0ubuntu1

---------------
ubuntuone-client (1.6.2-0ubuntu1) natty-proposed; urgency=low

  * Use Depends instead of Recommends to pull in Unity API (LP: #770379)
  * New upstream release.
    - Remove patches already included in upstream
    - Uploads fail due to starvation (LP: #767466, #766102)
    - Logging defaults to DEBUG, should be INFO (LP: #765441)
  * Require new version of ubuntuone-storage-protocol for LP: #767466
 -- Rodney Dawes <email address hidden> Wed, 27 Apr 2011 15:40:10 -0400

Changed in ubuntuone-client (Ubuntu Natty):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package ubuntuone-storage-protocol - 1.6.1-0ubuntu1

---------------
ubuntuone-storage-protocol (1.6.1-0ubuntu1) natty-proposed; urgency=low

  * New upstream release.
    - Uploads fail due to starvation (LP: #767466)
 -- Rodney Dawes <email address hidden> Wed, 27 Apr 2011 13:58:59 -0400

Changed in ubuntuone-storage-protocol (Ubuntu Natty):
status: Fix Committed → Fix Released
Revision history for this message
Martin Pitt (pitti) wrote :

Copied to oneiric as well.

Changed in ubuntuone-storage-protocol (Ubuntu Oneiric):
status: New → Fix Released
Changed in ubuntuone-client (Ubuntu Oneiric):
status: New → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.