Allow testing an exclude file (output list of files it matches)

[Daniel Hahler]

I'd like to have an interface/command to list the files that matches a given include/exclude pattern/file.

USE CASE:
I'm facing a problem, where duplicity (0.5.06, Ubuntu Hardy) backs up far too many files, and it appears to be related to my refactoring of excludes in the exclude file, from:
  + /var/lib/vz/private/111/var/lib/mysql/sqldump
  + /var/lib/vz/private/142/var/lib/mysql/sqldump
  /var/lib/vz/private/111/var/lib/mysql/*/
  /var/lib/vz/private/142/var/lib/mysql/*/
to
  + **/var/lib/mysql/sqldump
  **/var/lib/mysql/*/*
  (and adding)
  **/var/lib/mysql/ibdata1
  **/var/lib/mysql/ib_logfile*

It would be very helpful to easily test those patterns to track this down.

[Elifarley Cruz (elifarley)]

This bug is related to bug 884371

[Elifarley Cruz (elifarley)]

Using relative paths instead of prefixing all lines with "**" would be more reliable (avoiding possible false hits).

See spec use-relative-paths

[Elifarley Cruz (elifarley)]

spec use-relative-paths: https://blueprints.launchpad.net/duplicity/+spec/use-relative-paths

[Aaron Whitehouse (aaron-whitehouse)]

Hi Daniel,

Sorry for the delay in responding. You should be able to achieve what you want by adding --dry-run and -v5 to your duplicity command, e.g.:

duplicity . --dry-run -v5 --include=**.py --exclude=** file:///tmp

I believe that you could even grep out those lines starting with "A " to just see the files that are to be included:

duplicity . --dry-run -v5 --include=**.py --exclude=** file:///tmp | grep "A "

That isn't to say that a specific --list-matching-files command (or similar) would not be helpful.

I have recently made a number of improvements to filelist glob processing and suspect that I have fixed your underlying bug. It would be very helpful if you could please test with the next release (should be released in the coming days) and let me know if you still have a problem.

[Kenneth Loafman (kenneth-loafman)]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

 status confirmed
 importance medium
 done
-----BEGIN PGP SIGNATURE-----

iQEzBAEBCAAdFiEExwf+p6/3mDvUSsaGH1G0ZBEHM/EFAmBmHUYACgkQH1G0ZBEH
M/FZXwgAtoyCHNY3F5SlNB4i1TIdLDRyQdWZk/kyrc22eAA//llVNkAN3JXMl1PO
sFE6qZue4GIwJGCIhNEcX1S4D1ur9/rojuAjvB6yxQ8CwOMBY/DU5zrw6gu1OYvp
4NiPZkZAkO4N3RNpeLSQobJh/vcjHT2XDsCRMFYQjMqA7vDiN3LIxF8kSt6iBsQy
kBtcdz0GmS1RUI5j1y77uoaEhx8GZ1N/fRevh+SBCSZFuXkedpbeob2XQqHsJIS8
5l6Ywz4NzUw5krpd6OriMm8MxgmBmdjnQB9C3JoRLgDWsLdfo2VQ4tfBG0xok85N
Z89bHS/SbAqDKzQVXbi5IGAngTkdyQ==
=f1JR
-----END PGP SIGNATURE-----