Comment 7 for bug 1720159

Revision history for this message
Kenneth Loafman (kenneth-loafman) wrote : Re: [Bug 1720159] Re: Cannot allocate memory with large manifest file since 0.7.03

It may be that you have too many incrementals. Did you start a new full
backup?

On Wed, Mar 28, 2018 at 12:58 AM, ausboffin <email address hidden>
wrote:

> I have updated duplicity, but still getting memory error:
> Traceback (innermost last):
> File "/usr/bin/duplicity", line 1555, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1541, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1393, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1523, in do_backup
> incremental_backup(sig_chain)
> File "/usr/bin/duplicity", line 668, in incremental_backup
> globals.backend)
> File "/usr/bin/duplicity", line 430, in write_multivol
> globals.volsize)
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 385, in
> GPGWriteFile
> data = block_iter.next().data
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 520,
> in next
> result = self.process_continued()
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 711,
> in process_continued
> return self.tarinfo2tarblock(index, ti, data)
> File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 490,
> in tarinfo2tarblock
> return TarBlock(index, "%s%s%s" % (headers, file_data, filler_data))
> MemoryError
>
> Is there anything else that I can do?
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1720159
>
> Title:
> Cannot allocate memory with large manifest file since 0.7.03
>
> Status in Duplicity:
> Fix Released
>
> Bug description:
> Bug cause: https://bugs.launchpad.net/duplicity/+bug/1044715
> Question: https://answers.launchpad.net/duplicity/+question/658653
>
> Hi team
>
> I have used the duplicity for backup my server files from few months
> before. And It was working fine. Currently I have upgraded the
> duplicity new version(0.7.14), after upgraded the backup manifest
> cache file written in large size(near to GBs) due to bulk delete or
> changes in files.
>
> It was stopped the next backup process with this error - "OSError:
> [Errno 12] Cannot allocate memory".
>
> Please help me on this. Is there any way to solve this problem?
>
> Herewith I have placed the logged error information for your
> reference.
>
> Traceback (most recent call last):
> File "/usr/bin/duplicity", line 1548, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1534, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1383, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1515, in do_backup
> check_last_manifest(col_stats) # not needed for full backup
> File "/usr/bin/duplicity", line 1217, in check_last_manifest
> last_backup_set.check_manifests()
> File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py",
> line 208, in check_manifests
> remote_manifest = self.get_remote_manifest()
> File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py",
> line 241, in get_remote_manifest
> manifest_buffer = self.backend.get_data(self.remote_manifest_name)
> File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py",
> line 677, in get_data
> fin = self.get_fileobj_read(filename, parseresults)
> File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py",
> line 671, in get_fileobj_read
> return tdp.filtered_open_with_delete("rb")
> File "/usr/local/lib/python2.7/dist-packages/duplicity/dup_temp.py",
> line 120, in filtered_open_with_delete
> fh = FileobjHooked(path.DupPath.filtered_open(self, mode))
> File "/usr/local/lib/python2.7/dist-packages/duplicity/path.py", line
> 779, in filtered_open
> return gpg.GPGFile(False, self, gpg_profile)
> File "/usr/local/lib/python2.7/dist-packages/duplicity/gpg.py", line
> 217, in __init__
> 'logger': self.logger_fp})
> File "/usr/local/lib/python2.7/dist-packages/duplicity/gpginterface.py",
> line 374, in run
> create_fhs, attach_fhs)
> File "/usr/local/lib/python2.7/dist-packages/duplicity/gpginterface.py",
> line 414, in _attach_fork_exec
> process.pid = os.fork()
> OSError: [Errno 12] Cannot allocate memory
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1720159/+subscriptions
>