What version of librsync?


On Fri, Aug 19, 2016 at 3:52 AM, Peter Van Rompaey <email address hidden> wrote:

> Cried victory too soon, I'm afraid.
>
> I have:
> - compiled python 2.7.12 with the zlib patch
> - created a virtualenv with that version
> - installed duplicity in the virtualenv, along with lockfile and boto
>
> The zlib test now succeeds:
> (duplicity-venv) root@eniac:~# python -c "import
> zlib;zlib.crc32('a'*(1<<31 - 1))"
> (duplicity-venv) root@eniac:~# python -c "import
> zlib;zlib.crc32('a'*(1<<31))"
> (duplicity-venv) root@eniac:~#
>
> But duplicity still throws the OverFlowError during Incremental backup,
> and it wasn't anywhere near a large file. The modules mentioned in the
> Traceback are all in the duplicity dir, btw.
>
> ---
>
> DEBUG 1
> . Selection:     result: None from function: Command-line exclude glob:
> /var/lib/elasticsearch
>
> DEBUG 1
> . Selection:     + including file
>
> DEBUG 1
> . Selecting /var/log/lastlog
>
> DEBUG 1
> . Comparing var/log/lastlog and var/log/lastlog
>
> DEBUG 1
> . Getting delta of (var/log/lastlog reg) and (var/log/lastlog reg)
>
> DEBUG 1
> . Releasing lockfile /root/.cache/duplicity/d485e8d753a7b2ad7aafce096f9fbb
> 92/lockfile.lock
>
> DEBUG 1
> . Removing still remembered temporary file /tmp/duplicity-WNi8WI-tempdir/
> mktemp-yuJbZJ-3
>
> DEBUG 1
> . Removing still remembered temporary file /tmp/duplicity-WNi8WI-tempdir/
> mkstemp-hiRlXx-1
>
> ERROR 30 OverflowError
> . Traceback (most recent call last):
> .   File "/opt/duplicity-venv/bin/duplicity", line 1546, in <module>
> .     with_tempdir(main)
> .   File "/opt/duplicity-venv/bin/duplicity", line 1540, in with_tempdir
> .     fn()
> .   File "/opt/duplicity-venv/bin/duplicity", line 1391, in main
> .     do_backup(action)
> .   File "/opt/duplicity-venv/bin/duplicity", line 1522, in do_backup
> .     incremental_backup(sig_chain)
> .   File "/opt/duplicity-venv/bin/duplicity", line 671, in
> incremental_backup
> .     globals.backend)
> .   File "/opt/duplicity-venv/bin/duplicity", line 434, in write_multivol
> .     at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name, globals.volsize)
> .   File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/gpg.py",
> line 401, in GzipWriteFile
> .     new_block = block_iter.next()
> .   File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 523, in next
> .     result = self.process(self.input_iter.next())
> .   File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 218, in get_delta_iter
> .     (new_path, sig_path, sigTarFile))
> .   File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/robust.py",
> line 38, in check_common_error
> .     return function(*args)
> .   File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 139, in get_delta_path
> .     delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))
> .   File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/librsync.py",
> line 154, in __init__
> .     self.maker = _librsync.new_deltamaker(sig_string)
> . OverflowError: size does not fit in an int
>
> --
> You received this bug notification because you are subscribed to
> Duplicity.
> https://bugs.launchpad.net/bugs/1612554
>
> Title:
>   duplicity backup fails with OverflowError: size does not fit in an int
>
> Status in Duplicity:
>   Invalid
> Status in duplicity package in Ubuntu:
>   New
>
> Bug description:
>   Ubuntu 14.04.4 LTS
>   duplicity 0.6.23-1ubuntu4.1
>   python2.7 2.7.6-8ubuntu0.2
>
>   Backup command used:
>   duplicity --exclude-filelist "/root/.duplicity_excludes"
> --full-if-older-than 7D --log-file "/var/log/duplicity" --no-encryption
> --volsize 100 / "$S3BUCKET"
>
>   Backups have been running fine for several months, but since last
>   night it started giving following error:
>
>   ---
>
>   Reading filelist /root/.duplicity_excludes
>
>   Sorting filelist /root/.duplicity_excludes
>
>   Local and Remote metadata are synchronized, no sync needed.
>
>   Last full backup date: Sun Aug  7 23:30:02 2016
>
>   Traceback (most recent call last):
>
>     File "/usr/bin/duplicity", line 1494, in <module>
>
>       with_tempdir(main)
>
>     File "/usr/bin/duplicity", line 1488, in with_tempdir
>
>       fn()
>
>     File "/usr/bin/duplicity", line 1337, in main
>
>       do_backup(action)
>
>     File "/usr/bin/duplicity", line 1470, in do_backup
>
>       incremental_backup(sig_chain)
>
>     File "/usr/bin/duplicity", line 637, in incremental_backup
>
>       globals.backend)
>
>     File "/usr/bin/duplicity", line 405, in write_multivol
>
>       at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name,
>   globals.volsize)
>
>     File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 383,
>   in GzipWriteFile
>
>       new_block = block_iter.next()
>
>     File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
>   518, in next
>
>       result = self.process(self.input_iter.next())
>
>     File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
>   213, in get_delta_iter
>
>       (new_path, sig_path, sigTarFile))
>
>     File "/usr/lib/python2.7/dist-packages/duplicity/robust.py", line
>   37, in check_common_error
>
>       return function(*args)
>
>     File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
>   134, in get_delta_path
>
>       delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))
>
>     File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line
>   150, in __init__
>
>       self.maker = _librsync.new_deltamaker(sig_string)
>
>   OverflowError: size does not fit in an int
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1612554/+subscriptions
>