Comment 6 for bug 1860200

Could you please have a look at
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=848951 for discussion
around parallelizing gpg encryption (with reference to Duplicity)?
The conclusion I take away is that unless we push for change it probably
won't happen by itself anytime soon.
As mentioned at the end though, there is a wishlist category for gnupg and
the possibility to add this feature.

Does this have any influence on how you think about Duplicity?
Does is influence how you/we might approach parallelizing compression and
decompression?

On Thu, 20 Feb 2020 at 00:51, Kenneth Loafman <email address hidden> wrote:

> OK, my thinking is this. I may be wrong.
>
> There are three modes in storage: encrypted, compressed, plain.
> Duplicity is primarily used in the encrypted mode and that's where it
> needs the most help since encryption is inherently slow and suitable for
> only one CPU, AFAIK. The other modes I would discourage unless you are
> storing to an encrypted drive locally (big fan of encryption for
> privacy). Remote encryption means they have control of your keys and
> big brother can easily watch.
>
> What that means to me is that enhancing one path through the process is
> good, but we should really concentrate on making use of
> multithreading/multiprocessing where we can do the most good across all
> the modes.
>
> By making the backends individually responsible for one output file and
> one connection in each task we get a combination of multi-core and
> multi-connection savings by multitasking. Overall, I think that would
> be a better solution overall. However, it will require a bit of work.
>
> That said, I would not reject compression routine that is multithreaded.
> I would even help in the development some. I'm just looking at the big
> picture and offering tradeoffs.
>
> Sorry for the confusion.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1860200
>
> Title:
> Add multi core support for compression
>
> Status in Duplicity:
> In Progress
>
> Bug description:
> Duplicity compresses and decompresses with a single process atm.
> Performance can be increased by parallelizing this process. This in
> turn could be done using something like mgzip.
>
> https://code.launchpad.net/~byronester/duplicity/duplicity
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1860200/+subscriptions
>