Comment 2 for bug 562666

Revision history for this message
John A Meinel (jameinel) wrote : Re: [Bug 562666] [NEW] 2a fetch is very cpu intensive

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Michael Hudson wrote:
> Public bug reported:
>
> Because 2a fetch validates and filters the data it transfers, it is uses
> a lot of cpu -- for example, fetching an imported kernel (over a high
> bandwidth low latency link) uses about an hour of cpu time. git does it
> in about 20 seconds.
>
> There are reasons for done the validation and filtering, but perhaps
> there's a place for a dumb copy? I think Something Needs To Be Done, in
> any case.
>
> ** Affects: bzr
> Importance: Undecided
> Status: New
>

Note that moreso than just validating the data, it is probably
triggering the 'repack-on-the-fly' code, and extracting everything
(should be fairly cheap) and re-compressing it (generally pretty expensive).

This could also be improved using fetch_order='unordered' and weakening
the 'needs-repacking' check.

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkvFL8kACgkQJdeBCYSNAAOf+gCgnmGVBZXyfW9349XoUJsbjmTD
A58An02Fe9P7c5RCIhFHbrI9GR9T3jiU
=E/ra
-----END PGP SIGNATURE-----