download to stdout does not block when pipe is full

Bug #1727096 reported by Finlay Thompson
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
python-swiftclient
New
Undecided
Unassigned

Bug Description

When using swift to download directly to a linux pipe the swift process can run out of memory.

The use case is downloading a large fastq file (60Gb) and streaming it directly into an application that consumes the pipe.

The problem is that process that consumes the pipe can't keep up, and the pipe fills up. At this point the swift client should pause until it can write again, instead of buffering the file in memory.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.