Restore fails in Ubuntu 12.10

[Dan Gillmor]

Following a disk crash I loaded Ubuntu 12.10 and attempted to restore my home directory from an external drive partition. It failed with these messages.

Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1331, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line 522, in Write_ROPaths
    for ropath in rop_iter:
  File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line 495, in integrate_patch_iters
    final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) )
  File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line 475, in patch_seq2ropath
    misc.copyfileobj( current_file, tempfp )
  File "/usr/lib/python2.7/dist-packages/duplicity/misc.py", line 166, in copyfileobj
    buf = infp.read(blocksize)
  File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line 80, in read
    self._add_to_outbuf_once()
  File "/usr/lib/python2.7/dist-packages/duplicity/librsync.py", line 94, in _add_to_outbuf_once
    raise librsyncError(str(e))
librsyncError: librsync error 103 while in patch cycle

Several Canonical people have tried to help me in these 2 threads, but nothing has worked.

https://plus.google.com/u/0/113210431006401244170/posts/Src78g9WEFv (with links to reports that this is a confirmed bug)

https://plus.google.com/u/0/113210431006401244170/posts/LBLe3srpuTx

I can't stress enough how serious a problem this is.

Ubuntu 12.10
deja-dup 24.0-0ubuntu1
duplicity 0.6.19-0ubuntu2

"/tmp/deja-dup.log" was not created; error message in terminal:

(deja-dup:5751): GLib-GObject-CRITICAL **: g_object_unref: assertion `G_IS_OBJECT (object)' failed

[Dan Gillmor (dan-gillmor)]

Some progress. After downloading and installing this patch

http://paste.ubuntu.com/1370727/

I was able to get restore started. It failed after copying a few files with these messages:

Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1273, in main
    sync_archive(decrypt)
  File "/usr/bin/duplicity", line 1029, in sync_archive
    loclist = globals.archive_dir.listdir()
  File "/usr/lib/python2.7/dist-packages/duplicity/path.py", line 524, in listdir
    return os.listdir(self.name)
OSError: [Errno 2] No such file or directory: '/home/dangillmor/.cache/deja-dup/daa211ffa1333afc77073b81811f903f'

Not sure what's next but it feels like a small amount of progress.

[Dan Gillmor (dan-gillmor)]

Tried again, failed, but error messages are new:

 File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1331, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line 528, in Write_ROPaths
    for ropath in rop_iter:
  File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line 501, in integrate_patch_iters
    final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) )
  File "/usr/lib/python2.7/dist-packages/duplicity/patchdir.py", line 462, in patch_seq2ropath
    assert first.difftype != "diff", patch_seq
AssertionError: [(('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg), (('home', 'dangillmor', '.config', 'google-chrome', 'Default', 'History Index 2012-11') reg)]

[Alexandr Makovksy (mailboxmak)]

My error message:
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1277, in main
    globals.archive_dir).set_values()
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 691, in set_values
    self.get_backup_chains(partials + backend_filename_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 814, in get_backup_chains
    map(add_to_sets, filename_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 808, in add_to_sets
    log.Debug(_("File %s is not part of a known set; creating new set") % (filename,))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd0 in position 3: ordinal not in range(128)

[Michael Terry (mterry)]

Alexandr, your issue is bug 1080423.

Dan:
Your issue in comment #3 is bug 720525, which should be fixed if you delete ~/.cache/duplicity. (You shouldn't see this bug if you are using deja-dup, only if you are using duplicity directly. Is that the case?)

Your issue in commen #2 is odd. Maybe a result of the patch you applied?

Your original issue is bug 662442. I'll mark this as a dup of that bug. I agree that this is a serious issue.

[Dan Gillmor (dan-gillmor)]

I was using the "Backup" application, which I believe is deja-dup, correct? I also recently did a full reinstall (presumably back to the off-the-shelf version), and it still fails. I'll try deleting the cache file and see what happens.