duplicity creates huge backup archives

[Anders Aagaard]

Runnning this command:
# duplicity --no-encryption --volsize 25 --full-if-older-than 1M --s3-european-buckets --s3-use-new-style /path/ s3+http://path

# ls -lh ./.cache/duplicity/cb16c6c2ab88f146c07ca64f59318183/
total 73G
-rw------- 1 root root 2.1M 2011-10-11 21:52 duplicity-full.20110919T174252Z.manifest.part
-rw------- 1 root root 31G 2011-10-11 22:46 duplicity-full-signatures.20110919T174252Z.sigtar.gz
-rw------- 1 root root 43G 2011-10-11 21:52 duplicity-full-signatures.20110919T174252Z.sigtar.part

Most of my duplicity backups work fine, but in this directory it's not splitting the archives properly.

duplicity 0.6.14 ubuntu 10.10, python 2.6.6

[Anders Aagaard (aagaande)]

Note that the log referes to "windowsdomainserver", that's a clients server we take backup from. The system is linux. I use lftp and mirror all files to the linux server, then use duplicity to S3 for history and mirroring.

[Martin R. Siegert (martin-siegert)]

Dear Anders,

You go not observe too-big backup-archives (duplicity-*.vol*.difftar.gz) but too-large signatures (*.sigtar.*) , as it is outlined already since 2009 in https://bugs.launchpad.net/duplicity/+bug/385495 (and still not fixed yet, because of desired backwards-compatibility and number-of-open-files).

Regards,
Martin

[Anders Aagaard (aagaande)]

I'll subscribe to that bug then, thank you very much :)