Comment 3 for bug 1730451

Revision history for this message
Kenneth Loafman (kenneth-loafman) wrote : Re: [Bug 1730451] Re: MemoryError while verifying backup

@Olivier,

- When you upgraded to 0.7.15, did you remove the distro's version?

- How much memory do you have? Is it the same as previous?

- How long of an incremental change list do you have?

- Have you tried making a full backup?

On Wed, Jan 17, 2018 at 2:22 PM, Olivier Crête <email address hidden>
wrote:

> This isn't a duplicate of the previous, I can reproduce the same exact
> stack trace with 0.7.15 when trying to make a backup from deja-dup.
>
>
> Traceback (innermost last):
> File "/usr/bin/duplicity", line 1559, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1545, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1394, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1526, in do_backup
> check_last_manifest(col_stats) # not needed for full backup
> File "/usr/bin/duplicity", line 1228, in check_last_manifest
> last_backup_set.check_manifests()
> File "/usr/lib64/python2.7/site-packages/duplicity/collections.py",
> line 208, in check_manifests
> remote_manifest = self.get_remote_manifest()
> File "/usr/lib64/python2.7/site-packages/duplicity/collections.py",
> line 249, in get_remote_manifest
> return manifest.Manifest().from_string(manifest_buffer)
> File "/usr/lib64/python2.7/site-packages/duplicity/manifest.py", line
> 201, in from_string
> for match in vi_iterator:
> MemoryError
>
> ** This bug is no longer a duplicate of bug 1720159
> Cannot allocate memory with large manifest file since 0.7.03
>
> --
> You received this bug notification because you are subscribed to
> duplicity in Ubuntu.
> https://bugs.launchpad.net/bugs/1730451
>
> Title:
> MemoryError while verifying backup
>
> Status in duplicity package in Ubuntu:
> New
>
> Bug description:
> While trying to verify a backup (launched from deja-dup), I receive
> the following error. My system currently shows 11G of RAM available
> plus 23G of swap. Possibly related to #1720159?
>
> Traceback (most recent call last):
> File "/usr/bin/duplicity", line 1546, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1540, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1391, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1468, in do_backup
> restore(col_stats)
> File "/usr/bin/duplicity", line 731, in restore
> restore_get_patched_rop_iter(col_stats)):
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 560, in Write_ROPaths
> for ropath in rop_iter:
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 523, in integrate_patch_iters
> for patch_seq in collated:
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 389, in yield_tuples
> setrorps(overflow, elems)
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 378, in setrorps
> elems[i] = iter_list[i].next()
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 107, in filter_path_iter
> for path in path_iter:
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 121, in difftar2path_iter
> tarinfo_list = [tar_iter.next()]
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 339, in next
> self.set_tarfile()
> File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line
> 333, in set_tarfile
> self.current_fp = self.fileobj_iter.next()
> File "/usr/bin/duplicity", line 763, in get_fileobj_iter
> manifest = backup_set.get_manifest()
> File "/usr/lib/python2.7/dist-packages/duplicity/collections.py",
> line 250, in get_manifest
> return self.get_local_manifest()
> File "/usr/lib/python2.7/dist-packages/duplicity/collections.py",
> line 224, in get_local_manifest
> return manifest.Manifest().from_string(manifest_buffer)
> File "/usr/lib/python2.7/dist-packages/duplicity/manifest.py", line
> 214, in from_string
> for match in vi_iterator:
> MemoryError
>
> ProblemType: Bug
> DistroRelease: Ubuntu 17.10
> Package: duplicity 0.7.12-1ubuntu1
> ProcVersionSignature: Ubuntu 4.13.0-16.19-generic 4.13.4
> Uname: Linux 4.13.0-16-generic x86_64
> ApportVersion: 2.20.7-0ubuntu3.1
> Architecture: amd64
> CurrentDesktop: GNOME
> Date: Mon Nov 6 10:50:12 2017
> EcryptfsInUse: Yes
> InstallationDate: Installed on 2014-08-03 (1190 days ago)
> InstallationMedia: Ubuntu 14.04.1 LTS "Trusty Tahr" - Release amd64
> (20140722.2)
> SourcePackage: duplicity
> UpgradeStatus: Upgraded to artful on 2017-09-29 (37 days ago)
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/duplicity/+bug/
> 1730451/+subscriptions
>