Comment 15 for bug 1612554

Revision history for this message
Kenneth Loafman (kenneth-loafman) wrote : Re: [Bug 1612554] Re: duplicity backup fails with OverflowError: size does not fit in an int

Yep, exclude that and it should work.

On Tue, Aug 23, 2016 at 6:33 AM, Peter Van Rompaey <email address hidden> wrote:

> Re-ran the incremental backup, but it fails with the same error while
> adding /var/log/lastlog, which is a sparse file with a reported size of
> 36Gb, but actually only 56k on disk. Can this be the cause?
>
> ---
>
> (duplicity-venv) # ls -l /var/log/lastlog
> -rw-rw-r-- 1 root utmp 367219431264 Aug 23 09:57 /var/log/lastlog
>
> # du -k /var/log/lastlog
> 56 /var/log/lastlog
>
> ---
>
> Selecting /var/log/lastlog
> Comparing var/log/lastlog and var/log/lastlog
> Getting delta of (var/log/lastlog reg) and (var/log/lastlog reg)
> Releasing lockfile /root/.cache/duplicity/d485e8d753a7b2ad7aafce096f9fbb
> 92/lockfile.lock
> Removing still remembered temporary file /tmp/duplicity-0VnewC-tempdir/
> mktemp-MvQFNN-128
> Removing still remembered temporary file /tmp/duplicity-0VnewC-tempdir/
> mkstemp-Lc2BZc-1
> Traceback (most recent call last):
> File "/opt/duplicity-venv/bin/duplicity", line 1546, in <module>
> with_tempdir(main)
> File "/opt/duplicity-venv/bin/duplicity", line 1540, in with_tempdir
> fn()
> File "/opt/duplicity-venv/bin/duplicity", line 1391, in main
> do_backup(action)
> File "/opt/duplicity-venv/bin/duplicity", line 1522, in do_backup
> incremental_backup(sig_chain)
> File "/opt/duplicity-venv/bin/duplicity", line 671, in
> incremental_backup
> globals.backend)
> File "/opt/duplicity-venv/bin/duplicity", line 434, in write_multivol
> at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name, globals.volsize)
> File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/gpg.py",
> line 401, in GzipWriteFile
> new_block = block_iter.next()
> File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 523, in next
> result = self.process(self.input_iter.next())
> File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 218, in get_delta_iter
> (new_path, sig_path, sigTarFile))
> File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/robust.py",
> line 38, in check_common_error
> return function(*args)
> File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/diffdir.py",
> line 139, in get_delta_path
> delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))
> File "/opt/duplicity-venv/lib/python2.7/site-packages/duplicity/librsync.py",
> line 154, in __init__
> self.maker = _librsync.new_deltamaker(sig_string)
> OverflowError: size does not fit in an int
>
> --
> You received this bug notification because you are a bug assignee.
> https://bugs.launchpad.net/bugs/1612554
>
> Title:
> duplicity backup fails with OverflowError: size does not fit in an int
>
> Status in Duplicity:
> In Progress
> Status in duplicity package in Ubuntu:
> New
>
> Bug description:
> Ubuntu 14.04.4 LTS
> duplicity 0.6.23-1ubuntu4.1
> python2.7 2.7.6-8ubuntu0.2
>
> Backup command used:
> duplicity --exclude-filelist "/root/.duplicity_excludes"
> --full-if-older-than 7D --log-file "/var/log/duplicity" --no-encryption
> --volsize 100 / "$S3BUCKET"
>
> Backups have been running fine for several months, but since last
> night it started giving following error:
>
> ---
>
> Reading filelist /root/.duplicity_excludes
>
> Sorting filelist /root/.duplicity_excludes
>
> Local and Remote metadata are synchronized, no sync needed.
>
> Last full backup date: Sun Aug 7 23:30:02 2016
>
> Traceback (most recent call last):
>
> File "/usr/bin/duplicity", line 1494, in <module>
>
> with_tempdir(main)
>
> File "/usr/bin/duplicity", line 1488, in with_tempdir
>
> fn()
>
> File "/usr/bin/duplicity", line 1337, in main
>
> do_backup(action)
>
> File "/usr/bin/duplicity", line 1470, in do_backup
>
> incremental_backup(sig_chain)
>
> File "/usr/bin/duplicity", line 637, in incremental_backup
>
> globals.backend)
>
> File "/usr/bin/duplicity", line 405, in write_multivol
>
> at_end = gpg.GzipWriteFile(tarblock_iter, tdp.name,
> globals.volsize)
>
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 383,
> in GzipWriteFile
>
> new_block = block_iter.next()
>
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
> 518, in next
>
> result = self.process(self.input_iter.next())
>
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
> 213, in get_delta_iter
>
> (new_path, sig_path, sigTarFile))
>
> File "/usr/lib/python2.7/dist-packages/duplicity/robust.py", line
> 37, in check_common_error
>
> return function(*args)
>
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line
> 134, in get_delta_path
>
> delta_path.setfileobj(librsync.DeltaFile(old_sigfp, newfp))
>
> File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line
> 150, in __init__
>
> self.maker = _librsync.new_deltamaker(sig_string)
>
> OverflowError: size does not fit in an int
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1612554/+subscriptions
>