"No such file or directory" during backup

[Efstratios I. Charitos]

I have an automatic backup system setup running through a script in anacron. After upgrading to 14.04 duplicity fails with the following error (when run from termina)
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1494, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1488, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1337, in main
    do_backup(action)
  File "/usr/bin/duplicity", line 1458, in do_backup
    full_backup(col_stats)
  File "/usr/bin/duplicity", line 542, in full_backup
    globals.backend)
  File "/usr/bin/duplicity", line 403, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 327, in GPGWriteFile
    bytes_to_go = data_size - get_current_size()
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in get_current_size
    return os.stat(filename).st_size
OSError: [Errno 2] No such file or directory: '/tmp/duplicity-Hy90rz-tempdir/mktemp-SB_XJ9-2'

I am running 14.04 fully updated and
duplicity:
  Installed: 0.6.23-1ubuntu4
  Candidate: 0.6.23-1ubuntu4
  Version table:
 *** 0.6.23-1ubuntu4 0
        500 http://archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status

Any help?

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Sean Martin (nitrams0)]

This bug affected me but after following advice from a page I cannot find anymore,
rm -rf ~/.cache/deja-dup/*, I was able to complete the backup successfully.

[Efstratios I. Charitos (efstratios-charitos)]

Sean, do you have to rm -rf ~/.cache/deja-dup/* every time the anacron scripts runs or is it a one time thing?

[Sean Martin (nitrams0)]

Efstratios - The action "rm -rf ~/.cache/deja-dup/*" was a one-time deal for me.

The backup has been running just fine ever since.

[Olivier (oliv5kta)]

I'm affected as well, but the workaround in comment #2 does not work for me.
duplicity 0.6.23-1ubuntu4.1
deja-dup 30.0-0ubuntu4

I had this issue first when backuping a rather big directory (1.5Go). I deleted this backup and set up a new one (different directory, size ~500Mo), then it has been worked well for few weeks. The issue appeared again recently. I haven't found a way to make it work yet.

[Kenneth Loafman (kenneth-loafman)]

Go to https://launchpad.net/duplicity/+download and download the latest
duplicity. 0.6.13 is old and on a deprecated branch.

Before you run setup.py, run "sudo apt-get purge duplicity" to get rid of
the older version.

Then run "tar xf duplicity-0.7.06.tar.gz; cd duplicity-0.7.06; sudo python
setup.py" to install the new version.

On Sun, Feb 7, 2016 at 6:21 AM, Olivier <email address hidden> wrote:

> I'm affected as well, but the workaround in comment #2 does not work for
> me.
> duplicity 0.6.23-1ubuntu4.1
> deja-dup 30.0-0ubuntu4
>
> I had this issue first when backuping a rather big directory (1.5Go). I
> deleted this backup and set up a new one (different directory, size
> ~500Mo), then it has been worked well for few weeks. The issue appeared
> again recently. I haven't found a way to make it work yet.
>
> --
> You received this bug notification because you are subscribed to
> duplicity in Ubuntu.
> https://bugs.launchpad.net/bugs/1318833
>
> Title:
> duplicity backup fails in 14.04
>
> Status in duplicity package in Ubuntu:
> Confirmed
>
> Bug description:
> I have an automatic backup system setup running through a script in
> anacron. After upgrading to 14.04 duplicity fails with the following error
> (when run from termina)
> Traceback (most recent call last):
> File "/usr/bin/duplicity", line 1494, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1488, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1337, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1458, in do_backup
> full_backup(col_stats)
> File "/usr/bin/duplicity", line 542, in full_backup
> globals.backend)
> File "/usr/bin/duplicity", line 403, in write_multivol
> globals.gpg_profile, globals.volsize)
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 327, in
> GPGWriteFile
> bytes_to_go = data_size - get_current_size()
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in
> get_current_size
> return os.stat(filename).st_size
> OSError: [Errno 2] No such file or directory:
> '/tmp/duplicity-Hy90rz-tempdir/mktemp-SB_XJ9-2'
>
> I am running 14.04 fully updated and
> duplicity:
> Installed: 0.6.23-1ubuntu4
> Candidate: 0.6.23-1ubuntu4
> Version table:
> *** 0.6.23-1ubuntu4 0
> 500 http://archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
> 100 /var/lib/dpkg/status
>
> Any help?
>
> To manage notifications about this bug go to:
>
> https://bugs.launchpad.net/ubuntu/+source/duplicity/+bug/1318833/+subscriptions
>

[François Pernoud (francois-pernoud)]

Same problem here with duplicity 0.7.06, run from terminal on Ubuntu 15.10.

Not every run fails, so I manage to do backups with a loop in a script to re-run duplicity automatically when it happens to fail.

[Kenneth Loafman (kenneth-loafman)]

What command line?

Did you uninstall the repo version of duplicity before installing from
source?

On Fri, Apr 1, 2016 at 2:43 AM, François Pernoud <<email address hidden>
> wrote:

> Same problem here with duplicity 0.7.06, run from terminal on Ubuntu
> 15.10.
>
> Not every run fails, so I manage to do backups with a loop in a script
> to re-run duplicity automatically when it happens to fail.
>
> --
> You received this bug notification because you are subscribed to
> duplicity in Ubuntu.
> https://bugs.launchpad.net/bugs/1318833
>
> Title:
> duplicity backup fails in 14.04
>
> Status in duplicity package in Ubuntu:
> Confirmed
>
> Bug description:
> I have an automatic backup system setup running through a script in
> anacron. After upgrading to 14.04 duplicity fails with the following error
> (when run from termina)
> Traceback (most recent call last):
> File "/usr/bin/duplicity", line 1494, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1488, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1337, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1458, in do_backup
> full_backup(col_stats)
> File "/usr/bin/duplicity", line 542, in full_backup
> globals.backend)
> File "/usr/bin/duplicity", line 403, in write_multivol
> globals.gpg_profile, globals.volsize)
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 327, in
> GPGWriteFile
> bytes_to_go = data_size - get_current_size()
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in
> get_current_size
> return os.stat(filename).st_size
> OSError: [Errno 2] No such file or directory:
> '/tmp/duplicity-Hy90rz-tempdir/mktemp-SB_XJ9-2'
>
> I am running 14.04 fully updated and
> duplicity:
> Installed: 0.6.23-1ubuntu4
> Candidate: 0.6.23-1ubuntu4
> Version table:
> *** 0.6.23-1ubuntu4 0
> 500 http://archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
> 100 /var/lib/dpkg/status
>
> Any help?
>
> To manage notifications about this bug go to:
>
> https://bugs.launchpad.net/ubuntu/+source/duplicity/+bug/1318833/+subscriptions
>

[François Pernoud (francois-pernoud)]

The command line is :

duplicity --include-filelist duplicity.list -vi $HOME file::///media/francois/hubic/default/sauvegardes

where file duplicity.list is a file with a list of files and directories to be excluded (see attachment) and target is a filesystem mounted with hubicfuse.

I didn't uninstall version from repo neither reinstalled from source. I'll try that when time permits.

[Kenneth Loafman (kenneth-loafman)]

OK, try that first. It can get confused if two versions are present.

On Sat, Apr 2, 2016 at 10:37 AM, François Pernoud <
<email address hidden>> wrote:

> The command line is :
>
> duplicity --include-filelist duplicity.list -vi $HOME
> file::///media/francois/hubic/default/sauvegardes
>
> where file duplicity.list is a file with a list of files and directories
> to be excluded (see attachment) and target is a filesystem mounted with
> hubicfuse.
>
> I didn't uninstall version from repo neither reinstalled from source.
> I'll try that when time permits.
>
>
> ** Attachment added: "duplicity.list"
>
> https://bugs.launchpad.net/ubuntu/+source/duplicity/+bug/1318833/+attachment/4620690/+files/duplicity.list
>
> --
> You received this bug notification because you are subscribed to
> duplicity in Ubuntu.
> https://bugs.launchpad.net/bugs/1318833
>
> Title:
> duplicity backup fails in 14.04
>
> Status in duplicity package in Ubuntu:
> Confirmed
>
> Bug description:
> I have an automatic backup system setup running through a script in
> anacron. After upgrading to 14.04 duplicity fails with the following error
> (when run from termina)
> Traceback (most recent call last):
> File "/usr/bin/duplicity", line 1494, in <module>
> with_tempdir(main)
> File "/usr/bin/duplicity", line 1488, in with_tempdir
> fn()
> File "/usr/bin/duplicity", line 1337, in main
> do_backup(action)
> File "/usr/bin/duplicity", line 1458, in do_backup
> full_backup(col_stats)
> File "/usr/bin/duplicity", line 542, in full_backup
> globals.backend)
> File "/usr/bin/duplicity", line 403, in write_multivol
> globals.gpg_profile, globals.volsize)
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 327, in
> GPGWriteFile
> bytes_to_go = data_size - get_current_size()
> File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in
> get_current_size
> return os.stat(filename).st_size
> OSError: [Errno 2] No such file or directory:
> '/tmp/duplicity-Hy90rz-tempdir/mktemp-SB_XJ9-2'
>
> I am running 14.04 fully updated and
> duplicity:
> Installed: 0.6.23-1ubuntu4
> Candidate: 0.6.23-1ubuntu4
> Version table:
> *** 0.6.23-1ubuntu4 0
> 500 http://archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
> 100 /var/lib/dpkg/status
>
> Any help?
>
> To manage notifications about this bug go to:
>
> https://bugs.launchpad.net/ubuntu/+source/duplicity/+bug/1318833/+subscriptions
>

[François Pernoud (francois-pernoud)]

So I have uninstalled repo version and reinstalled from source, and got the error again, though it was with different command line:

duplicity -vi --no-compression --no-encryption /home/francois/Photos/ file:///media/francois/hubic/sauvegardes/Photos

here are the last messages (in french, sorry):

AsyncScheduler: exécution synchronisée de la tâche (asynchronisme désactivé)
Ecriture de duplicity-full.20160403T144733Z.vol20.difftar
Suppression de /tmp/duplicity-UKY9HI-tempdir/mktemp-R1ilOf-21
AsyncScheduler: tâche achevée avec succès
Processed volume 20
A 2008/05/11/11320033.JPG
A 2008/05/11/11320034.JPG
A 2008/05/11/11320035.JPG
A 2008/05/11/11320036.JPG
A 2008/05/11/11320037.JPG
A 2008/05/11/11330001.JPG
AsyncScheduler: exécution synchronisée de la tâche (asynchronisme désactivé)
Ecriture de duplicity-full.20160403T144733Z.vol21.difftar
Giving up after 1 attempts. IOError: [Errno 2] No such file or directory