collection-status slower with full cache than with empty cache

Bug #1698148 reported by Mahdi Mokhtari
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Duplicity
Fix Released
Medium
Unassigned

Bug Description

Running `duply duplitest status` (which runs duplicity collection-status) takes a bit over 2 minutes, removing the files from the cache directory and running `duply duplitest status` again, it only takes one second to run. I would consider the opposite effect to be logical, e.g. having to download all the cache files from the backup target location (which is in file:///tmp, btw), but it seems, duplicity simply skips over the part where it looks into the manifest files etc, if they aren't there and just enumerates the files from the outside (looking at the target location) to create the collection status.

Two logs are attached as test-cases and proofs.
The tested version is 0.7.12 on FreeBSD 10.3
(Naturally, The attachments are anonymized :D)

Revision history for this message
Mahdi Mokhtari (mokhi64) wrote :
Revision history for this message
Mahdi Mokhtari (mokhi64) wrote :
Revision history for this message
Kenneth Loafman (kenneth-loafman) wrote :

What you are seeing is the difference between having the cache already synchronized versus having to resync the local cache from the remote store. It has nothing to do with the cache name.

Changed in duplicity:
status: New → Invalid
Changed in duplicity:
status: Invalid → In Progress
assignee: nobody → Kenneth Loafman (kenneth-loafman)
importance: Undecided → Medium
milestone: none → 0.7.14
summary: - --name option does extra/unnecessary recursion in directory to find
- manifest files (slowing down performance)
+ collection-status slower with full cache than with empty cache
description: updated
description: updated
Revision history for this message
Kenneth Loafman (kenneth-loafman) wrote :

* Patched in lp:~dawgfoto/duplicity/skip_sync_collection_status
  - collection-status should not sync metadata
  - up-to-date local metadata is not needed as collection-status is
    generated from remote file list
  - syncing metadata might require to download several GBs

Changed in duplicity:
assignee: Kenneth Loafman (kenneth-loafman) → nobody
status: In Progress → Fix Committed
Changed in duplicity:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.