This was affecting me as well. Once I got to several hundred backups, it would fail very often. I don't understand why boto is timing out on S3 LISTs, but I sure know how to work around it. :)
The attached patch adds retry logic to the LIST requests. I just copied the retry code used in GET and PUT. I wanted to remove the duplication of retry code between all three, but the retry code isn't under test and I didn't want to risk breaking something.
This was affecting me as well. Once I got to several hundred backups, it would fail very often. I don't understand why boto is timing out on S3 LISTs, but I sure know how to work around it. :)
The attached patch adds retry logic to the LIST requests. I just copied the retry code used in GET and PUT. I wanted to remove the duplication of retry code between all three, but the retry code isn't under test and I didn't want to risk breaking something.