Try using the --asynchronous-upload option. It will overlap the marshal/upload cycle to an extent and keep the network a bit busier overall. Work on threading the marshaling process needs to be done, but the complexity of the various parallel, nested, complex iterators makes that a daunting proposition without an almost complete rewrite.
Try using the --asynchronous- upload option. It will overlap the marshal/upload cycle to an extent and keep the network a bit busier overall. Work on threading the marshaling process needs to be done, but the complexity of the various parallel, nested, complex iterators makes that a daunting proposition without an almost complete rewrite.