duplicity doesnt read existing webdav backups

Bug #1771339 reported by Bernd on 2018-05-15
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Kenneth Loafman

Bug Description


i am trying to push my backups to my seafile cloud which supports webdav.
Duplicity is able to upload the backup but doesn't recognize the existing backup afterwards:
"Last full backup date: none"

Its definetly on the server.

When I use lftp+webdavs instead of just webdavs it can read existing backups but has trouble uploading new ones (so basically the other way around of just webdavs).

With lftp 4.6.3a everything works fine but this version cannot be installed on Ubuntu 18.04.

I'd like just webdavs to work as expected. Any help is appreciated!
duplicity 0.7.17
Ubuntu 18.04
Python2 2.7.15rc1
Python3 3.6.5
lftp 4.8.1 (non working as described above)

Here is the duplicity log:

$ /opt/duplicity-backup/duplicity-backup.sh -c /opt/duplicity-backup/duplicity-backup.conf -b

Using archive dir: /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d
Using backup name: cace98e3e9bcbb7b4e7c39c2fe22290d
Import of duplicity.backends.acdclibackend Succeeded
Import of duplicity.backends.azurebackend Succeeded
Import of duplicity.backends.b2backend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.hubicbackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.lftpbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.mediafirebackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.multibackend Succeeded
Import of duplicity.backends.ncftpbackend Succeeded
Import of duplicity.backends.onedrivebackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.pydrivebackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.ssh_paramiko_backend Succeeded
Import of duplicity.backends.ssh_pexpect_backend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Using WebDAV protocol http
Using WebDAV host seafile.example.com port None
Using WebDAV directory /seafdav/server-backup/
Main action: inc
duplicity 0.7.17 (February 26, 2018)
Args: /usr/bin/duplicity -v8 --full-if-older-than 14D --include=/etc/fstab --exclude=** / webdavs://backup@<email address hidden>/seafdav/server-backup
Linux vps 4.15.0-20-generic #21-Ubuntu SMP Tue Apr 24 06:16:15 UTC 2018 x86_64 x86_64
/usr/bin/python 2.7.15rc1 (default, Apr 15 2018, 21:51:34)
[GCC 7.3.0]
Using temporary directory /tmp/duplicity-0rnrkj-tempdir
Temp has 16999583744 available, backup will use approx 272629760.
WebDAV create connection on 'seafile.example.com'
WebDAV PROPFIND /seafdav/server-backup/ request with headers: {'Connection': 'keep-alive', 'Depth': '1'}
WebDAV data length: 95
WebDAV response status 401 with reason 'Not Authorized'.
WebDAV retry request with authentification headers.
WebDAV PROPFIND /seafdav/server-backup/ request2 with headers: {'Connection': 'keep-alive', 'Depth': '1', 'Authorization': 'Basic KEY_REMOVED'}
WebDAV data length: 95
WebDAV response2 status 207 with reason 'Multistatus'.
Local and Remote metadata are synchronized, no sync needed.
WebDAV PROPFIND /seafdav/server-backup/ request with headers: {'Connection': 'keep-alive', 'Depth': '1', 'Authorization': 'Basic KEY_REMOVED'}
WebDAV data length: 95
WebDAV response status 207 with reason 'Multistatus'.
Last full backup date: none
Last full backup is too old, forcing full backup
Collection Status
Connecting with backend: BackendWrapper
Archive dir: /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d

Found 0 secondary backup chains.
No backup chains with active signatures found
No orphaned or incomplete backup sets found.
Using temporary directory /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d/duplicity-uIymon-tempdir
Using temporary directory /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d/duplicity-dFfyNy-tempdir
AsyncScheduler: instantiating at concurrency 0
A .
A etc
A etc/fstab
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20180515T123144Z.vol1.difftar.gpg
WebDAV PUT /seafdav/server-backup/duplicity-full.20180515T123144Z.vol1.difftar.gpg request with headers: {'Connection': 'keep-alive', 'Authorization': 'Basic KEY_REMOVED'}
WebDAV data length: 334
WebDAV response status 201 with reason 'Created'.
Deleting /tmp/duplicity-0rnrkj-tempdir/mktemp-0hSQw9-2
AsyncScheduler: task completed successfully
Processed volume 1
Writing duplicity-full-signatures.20180515T123144Z.sigtar.gpg
WebDAV PUT /seafdav/server-backup/duplicity-full-signatures.20180515T123144Z.sigtar.gpg request with headers: {'Connection': 'keep-alive', 'Authorization': 'Basic KEY_REMOVED'}
WebDAV data length: 288
WebDAV response status 201 with reason 'Created'.
Deleting /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d/duplicity-full-signatures.20180515T123144Z.sigtar.gpg
Writing duplicity-full.20180515T123144Z.manifest.gpg
WebDAV PUT /seafdav/server-backup/duplicity-full.20180515T123144Z.manifest.gpg request with headers: {'Connection': 'keep-alive', 'Authorization': 'Basic KEY_REMOVED'}
WebDAV data length: 195
WebDAV response status 201 with reason 'Created'.
Deleting /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d/duplicity-full.20180515T123144Z.manifest.gpg
WebDAV PROPFIND /seafdav/server-backup/ request with headers: {'Connection': 'keep-alive', 'Depth': '1', 'Authorization': 'Basic KEY_REMOVED'}
WebDAV data length: 95
WebDAV response status 207 with reason 'Multistatus'.
--------------[ Backup Statistics ]--------------
StartTime 1526387504.53 (Tue May 15 12:31:44 2018)
EndTime 1526387504.59 (Tue May 15 12:31:44 2018)
ElapsedTime 0.06 (0.06 seconds)
SourceFiles 3
SourceFileSize 8301 (8.11 KB)
NewFiles 3
NewFileSize 8301 (8.11 KB)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 3
RawDeltaSize 109 (109 bytes)
TotalDestinationSizeChange 334 (334 bytes)
Errors 0

----------------[ Duplicity Cleanup ]----------------
Synchronizing remote metadata to local cache...
Deleting local /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d/duplicity-full-signatures.20180515T123144Z.sigtar.gz (not authoritative at backend).
Deleting local /root/.cache/duplicity/cace98e3e9bcbb7b4e7c39c2fe22290d/duplicity-full.20180515T123144Z.manifest (not authoritative at backend).
Last full backup date: none
No old backup sets found, nothing deleted.

-----------[ Source Disk Use Information ]-----------
4.0K /etc/fstab

---------[ Destination Disk Use Information ]--------
Destination disk use information is currently only available for the following storage backends:
File, SSH, Amazon S3 and Google Cloud

Have you tried lftp 4.8.1-1 from Bionic? How does it fail?

If you list the webdav directory, do the filenames appear correct? Compare the filenames in the cache to the ones in webdav. Any syntax changes?

Changed in duplicity:
status: New → In Progress
assignee: nobody → Kenneth Loafman (kenneth-loafman)
importance: Undecided → Medium
milestone: none → 0.7.18

Please attach duplicity-backup.conf.

Please use another tool to list the files in your webdav bucket.

Changed in duplicity:
status: In Progress → Incomplete
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers