Comment 3 for bug 1264744

Revision history for this message
Scott McKenzie (noizyland) wrote : Re: exclude-globbing-filelist don't works

I am experiencing the same problem and I've found it is triggered by the --progress flag.

The following demonstrates the problem:
location=~/duplicity-test
mkdir -p "$location"/{.cache,src,dst}
mkdir -p "$location"/src/{dir1,dir2}/{subdir1,subdir2}
find "$location/src" -type d -exec touch {}/testfile \;
echo "- $location/src/dir2/subdir2" > "$location/exclude"
duplicity --archive-dir "$location/.cache" --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist "$location/exclude" "$location/src" file://"$location/dst"
Using archive dir: /home/scott/duplicity-test/.cache/test_backup
Using backup name: test_backup
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.copycombackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Reading globbing filelist /home/scott/duplicity-test/exclude
Main action: inc
================================================================================
duplicity 0.7.0 ($reldate)
Args: /usr/bin/duplicity --archive-dir /home/scott/duplicity-test/.cache --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist /home/scott/duplicity-test/exclude /home/scott/duplicity-test/src file:///home/scott/duplicity-test/dst
Linux ddsmash 3.16.0-28-generic #38-Ubuntu SMP Sat Dec 13 16:13:28 UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2]
================================================================================
Using temporary directory /tmp/duplicity-gzjWQ7-tempdir
Temp has 35840032768 available, backup will use approx 34078720.
Local and Remote metadata are synchronised, no sync needed.
Last full backup date: none
No signatures found, switching to full backup.
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-xqRenW-tempdir
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-y6w8cZ-tempdir
AsyncScheduler: instantiating at concurrency 0
A .
A dir1
A dir1/subdir1
A dir1/subdir1/testfile
A dir1/subdir2
A dir1/subdir2/testfile
A dir1/testfile
A dir2
A dir2/subdir1
A dir2/subdir1/testfile
A dir2/testfile
A testfile
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20150108T185804Z.vol1.difftar.gz
Deleting /tmp/duplicity-gzjWQ7-tempdir/mktemp-LZ1B2R-2
AsyncScheduler: task completed successfully
Processed volume 1
--------------[ Backup Statistics ]--------------
StartTime 1420743484.04 (Fri Jan 9 05:58:04 2015)
EndTime 1420743484.05 (Fri Jan 9 05:58:04 2015)
ElapsedTime 0.00 (0.00 seconds)
SourceFiles 12
SourceFileSize 168 (168 bytes)
NewFiles 12
NewFileSize 168 (168 bytes)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 12
RawDeltaSize 0 (0 bytes)
TotalDestinationSizeChange 252 (252 bytes)
Errors 0
-------------------------------------------------

All good so far. If I now run the same command with the progress flag the --exclude-globbing-filelist is ignored and dir2/subdir2/testfile will be backed up:
> duplicity --progress --archive-dir "$location/.cache" --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist "$location/exclude" "$location/src" file://"$location/dst"
Using archive dir: /home/scott/duplicity-test/.cache/test_backup
Using backup name: test_backup
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.copycombackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Reading globbing filelist /home/scott/duplicity-test/exclude
Main action: inc
================================================================================
duplicity 0.7.0 ($reldate)
Args: /usr/bin/duplicity --progress --archive-dir /home/scott/duplicity-test/.cache --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist /home/scott/duplicity-test/exclude /home/scott/duplicity-test/src file:///home/scott/duplicity-test/dst
Linux ddsmash 3.16.0-28-generic #38-Ubuntu SMP Sat Dec 13 16:13:28 UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2]
================================================================================
Using temporary directory /tmp/duplicity-tKtwsJ-tempdir
Temp has 35840000000 available, backup will use approx 34078720.
Local and Remote metadata are synchronised, no sync needed.
Last full backup date: Fri Jan 9 05:58:04 2015
Deleting /tmp/duplicity-tKtwsJ-tempdir/mktemp-L3fYz0-2
Reading globbing filelist /home/scott/duplicity-test/exclude
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-SfAj0g-tempdir
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-odaZX9-tempdir
AsyncScheduler: instantiating at concurrency 0
A dir2/subdir2
A dir2/subdir2/testfile
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-inc.20150108T185804Z.to.20150108T190112Z.vol1.difftar.gz
Deleting /tmp/duplicity-tKtwsJ-tempdir/mktemp-bErzPB-3
AsyncScheduler: task completed successfully
Processed volume 1
0.0KB 00:00:03 [0.0KB/s] [========================================>] 100% ETA 0sec
--------------[ Backup Statistics ]--------------
StartTime 1420743672.67 (Fri Jan 9 06:01:12 2015)
EndTime 1420743672.67 (Fri Jan 9 06:01:12 2015)
ElapsedTime 0.00 (0.00 seconds)
SourceFiles 14
SourceFileSize 184 (184 bytes)
NewFiles 2
NewFileSize 16 (16 bytes)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 2
RawDeltaSize 0 (0 bytes)
TotalDestinationSizeChange 137 (137 bytes)
Errors 0
-------------------------------------------------