Comment 8 for bug 1612554

What version of librsync?

On Fri, Aug 19, 2016 at 3:52 AM, Peter Van Rompaey <email address hidden> wrote:

> Cried victory too soon, I'm afraid.
>
> I have:
> - compiled python 2.7.12 with the zlib patch
> - created a virtualenv with that version
> - installed duplicity in the virtualenv, along with lockfile and boto
>
> The zlib test now succeeds:
> (duplicity-venv) root@eniac:~# python -c "import
> zlib;zlib.crc32('a'*(1<<31 - 1))"
> (duplicity-venv) root@eniac:~# python -c "import
> zlib;zlib.crc32('a'*(1<<31))"
> (duplicity-venv) root@eniac:~#
>
> But duplicity still throws the OverFlowError during Incremental backup,
> and it wasn't anywhere near a large file. The modules mentioned in the
> Traceback are all in the duplicity dir, btw.
>
> ---
>
> DEBUG 1
> . Selection: result: None from function: Command-line exclude glob:
> /var/lib/elasticsearch
>
> DEBUG 1
> . Selection: + including file
>
> DEBUG 1
> . Selecting /var/log/lastlog
>
> DEBUG 1
> . Comparing var/log/lastlog and var/log/lastlog
>
> DEBUG 1
> . Getting delta of (var/log/lastlog reg) and (var/log/lastlog reg)
>
> DEBUG 1
> . Releasing lockfile /root/.cache/duplicity/d485e8d753a7b2ad7aafce096f9fbb
> 92/lockfile.lock
>
> DEBUG 1
> . Removing still remembered temporary file /tmp/duplicity-WNi8WI-tempdir/
> mktemp-yuJbZJ-3
>
> DEBUG 1
> . Removing still remembered temporary file /tmp/duplicity-WNi8WI-tempdir/
> mkstemp-hiRlXx-1
>
> ERROR 30 OverflowError
> . Traceback (most recent call last):
> . File "/opt/duplicity-venv/bin/duplicity", line 1546, in <module>
> . with_tempdir(main)
> . File "/opt/duplicity-venv/bin/duplicity", line 1540, in with_tempdir
> . fn()
> . File "/opt/duplicity-venv/bin/duplicity", line 1391, in main
> . do_backup(action)
> . File "/opt/duplicity-venv/bin/duplicity", line 1522, in do_backup
> . incremental_backup(sig_chain)
> . File "/opt/duplicity-venv/bin/duplicity", line 671, in
> incremental_backup
> . globals.backend)
> . File "/opt/duplicity-venv/bin/duplicity", line 434, in write_multivol
> . at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name, globals.volsize)
> . File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/gpg.py",
> line 401, in GzipWriteFile
> . new_block = block_iter.next()
> . File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 523, in next
> . result = self.process(self.input_iter.next())
> . File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 218, in get_delta_iter
> . (new_path, sig_path, sigTarFile))
> . File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/robust.py",
> line 38, in check_common_error
> . return function(*args)
> . File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 139, in get_delta_path
> . delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))
> . File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/librsync.py",
> line 154, in __init__
> . self.maker = _librsync.new_deltamaker(sig_string)
> . OverflowError: size does not fit in an int
>
> --
> You received this bug notification because you are subscribed to
> Duplicity.
> https://bugs.launchpad.net/bugs/1612554
>
> Title:
> duplicity backup fails with OverflowError: size does not fit in an int
>
> Status in Duplicity:
> Invalid
> Status in duplicity package in Ubuntu:
> New
>
> Bug description:
> Ubuntu 14.04.4 LTS
> duplicity 0.6.23-1ubuntu4.1
> python2.7 2.7.6-8ubuntu0.2
>
> Backup command used:
> duplicity --exclude-filelist "/root/.duplicity_excludes"
> --full-if-older-than 7D --log-file "/var/log/duplicity" --no-encryption
> --volsize 100 / "$S3BUCKET"
>
> Backups have been running fine for several months, but since last
> night it started giving following error:
>
> ---
>
> Reading filelist /root/.duplicity_excludes
>
> Sorting filelist /root/.duplicity_excludes
>
> Local and Remote metadata are synchronized, no sync needed.
>
> Last full backup date: Sun Aug 7 23:30:02 2016
>
> Traceback (most recent call last):
>
> File "/usr/bin/duplicity", line 1494, in <module>
>
> with_tempdir(main)
>
> File "/usr/bin/duplicity", line 1488, in with_tempdir
>
> fn()
>
> File "/usr/bin/duplicity", line 1337, in main
>
> do_backup(action)
>
> File "/usr/bin/duplicity", line 1470, in do_backup
>
> incremental_backup(sig_chain)
>
> File "/usr/bin/duplicity", line 637, in incremental_backup
>
> globals.backend)
>
> File "/usr/bin/duplicity", line 405, in write_multivol
>
> at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name,
> globals.volsize)
>
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 383,
> in GzipWriteFile
>
> new_block = block_iter.next()
>
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
> 518, in next
>
> result = self.process(self.input_iter.next())
>
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
> 213, in get_delta_iter
>
> (new_path, sig_path, sigTarFile))
>
> File "/usr/lib/python2.7/dist-packages/duplicity/robust.py", line
> 37, in check_common_error
>
> return function(*args)
>
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
> 134, in get_delta_path
>
> delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))
>
> File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line
> 150, in __init__
>
> self.maker = _librsync.new_deltamaker(sig_string)
>
> OverflowError: size does not fit in an int
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1612554/+subscriptions
>