dumb http servers make packs perform very badly

Bug #175886 reported by Vincent Ladeuil
10
Affects Status Importance Assigned to Milestone
Bazaar
Fix Released
High
Vincent Ladeuil

Bug Description

bialix reported that using tracd on windows (itself using the python HTTP server) responds to range requests by sending back the *whole* file.

The urllib implementation crashes bzr while pycurl is very slow.

Related branches

Vincent Ladeuil (vila)
Changed in bzr:
assignee: nobody → v-ladeuil
importance: Undecided → High
milestone: none → 1.0rc3
status: New → Confirmed
Revision history for this message
John A Meinel (jameinel) wrote :

It is a valid response based on the HTTP spec. We just need to figure out a way to prevent our performance from becoming horrible.

We also have poor scaling when the number of packs become large, but maybe a way to be less aggressive on repacking for specific repositories?

Revision history for this message
Vincent Ladeuil (vila) wrote :

Ranges are a HTTP 1.1 addition, so yes a 1.0 server MAY reply that way.

Vincent Ladeuil (vila)
Changed in bzr:
status: Confirmed → Fix Committed
Vincent Ladeuil (vila)
Changed in bzr:
milestone: 1.0rc3 → 1.0final
status: Fix Committed → Fix Released
Revision history for this message
Vincent Ladeuil (vila) wrote :

The fix is vailable in bzr.dev and will find its way in bzr 1.1

Changed in bzr:
milestone: 1.0final → 1.1
Revision history for this message
tebeka (miki-tebeka) wrote :

Using bzr.dev as of today (Dec 23, 07), I still have the same error as in https://bugs.launchpad.net/bugs/177613

Revision history for this message
Vincent Ladeuil (vila) wrote :

Can you attach the relevant traceback and tell us more about the http server you're running against (brand, version) ?

Revision history for this message
tebeka (miki-tebeka) wrote : Re: [Bug 175886] Re: dumb http servers make packs perform very badly

Hello Vila,

> Can you attach the relevant traceback and tell us more about the http
Same traceback as in initial post.
(I've switched to a smart server now and deleted the HTTP "dump"
configuration ...)

> server you're running against (brand, version) ?
lighttpd 1.4.18

All the best,
--
Miki Tebeka <email address hidden>
http://pythonwise.blogspot.com/
The only difference between children and adults is the price of the toys

Revision history for this message
Vincent Ladeuil (vila) wrote :

I installed lighttpd 1.4.18 and found a bug (#179368) regarding multiple range requests.

Subscribe to it if you want to be kept informed on progress.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.