UnicodeDecodeError while listing UTF-8 remote files

[Alexandre Pocquet]

Hi,

After successfully backuping most part of a system, I cannot list the remote files:

$ duplicity --file-prefix-manifest meta_ --file-prefix-signature meta_ --file-prefix-archive data_ list 'multi:///backends.json?mode=mirror&onfail=abort'
....
Mon Apr 9 11:39:14 2018 etc/ssl/certs/9d520b32.0
Mon Apr 9 11:39:13 2018 etc/ssl/certs/9d6523ce.0
Mon Apr 9 11:39:14 2018 etc/ssl/certs/9dbefe7b.0
Mon Apr 9 11:39:14 2018 etc/ssl/certs/9ec3a561.0
Mon Apr 9 11:39:14 2018 etc/ssl/certs/9f0f5fd6.0
Mon Apr 9 11:39:13 2018 etc/ssl/certs/9f533518.0
Mon Apr 9 11:39:14 2018 etc/ssl/certs/9fdcb408.0
Thu Oct 23 16:11:59 2014 etc/ssl/certs/ACCVRAIZ1.pem
Thu Sep 11 18:36:05 2014 etc/ssl/certs/ACEDICOM_Root.pem
Mon Apr 9 11:39:13 2018 etc/ssl/certs/AC_RAIZ_FNMT-RCM.pem
Traceback (innermost last):
  File "/usr/local/bin/duplicity", line 1668, in <module>
    with_tempdir(main)
  File "/usr/local/bin/duplicity", line 1654, in with_tempdir
    fn()
  File "/usr/local/bin/duplicity", line 1501, in main
    do_backup(action)
  File "/usr/local/bin/duplicity", line 1584, in do_backup
    list_current(col_stats)
  File "/usr/local/bin/duplicity", line 694, in list_current
    for path in path_iter:
  File "/usr/local/lib/python2.7/dist-packages/duplicity/diffdir.py", line 354, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/diffdir.py", line 341, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/local/lib/python2.7/dist-packages/duplicity/diffdir.py", line 327, in get_triple
    path = next(path_iter_list[iter_index])
  File "/usr/local/lib/python2.7/dist-packages/duplicity/diffdir.py", line 249, in sigtar2path_iter
    index = tuple(name.split(u"/"))
 UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 19: ordinal not in range(128)

$ ls /etc/ssl/certs/AC*
/etc/ssl/certs/ACCVRAIZ1.pem /etc/ssl/certs/AC_Raíz_Certicámara_S.A..pem
/etc/ssl/certs/ACEDICOM_Root.pem /etc/ssl/certs/AC_RAIZ_FNMT-RCM.pem

$ echo $LANG
en_GB.UTF-8

I think the bug is triggered by the "AC_Raíz_Certicámara_S.A..pem" file, which contains UTF-8 characters. The initial full backup went well, but the incremental backup seems broken as well, with the same exception in sigtar2path_iter.

Duplicity version: 0.8-series rev 1336
Python version: 2.7.3-4+deb7u1
OS: Debian Wheezy 7.11

[Pete Zaitcev (zaitcev)]

Seems like a duplicate with bug 1797797.