Ring load is slow: use bufferedio with gzipfile

[Therese McHale]

swift uses pickle.load(gzipfile(self.pickle_gz_path,'rb)) to load a ring. With larger rings (e.g. 2M zipped, 6M unzipped ) the load ..specifically the uncompress ...is very slow. Use of BufferedReader as per http://bugs.python.org/issue7471 appears to improve the load perfomance signficantly. Testing with 1.4.3 of swift but 1.4.4 seems the same

[Therese McHale (therese-mchale)]

I will submit fix for review

[Therese McHale (therese-mchale)]

Submitted Change Ia4b0d212 for review

[Chmouel Boudjnah (chmouel)]

Hi Therere, the change you are referencing is :

https://review.openstack.org/#/c/1968/

any chance to sign the CLA :

http://wiki.openstack.org/HowToContribute

to restore this change, so we can review it and could get us this speed improvement.

Thanks and let me know if you need help with that.

[Therese McHale (therese-mchale)]

Hi, I believe I signed the cla. I am listed on http://wiki.openstack.org/Contributors and as per the comments on https://review.openstack.org/#/c/1968/ I did sign it. thanks .

[Chmouel Boudjnah (chmouel)]

apologies i misunderstood the commit, so are you interested to fix the
error reported by John?

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/8658

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/8658
Committed: http://github.com/openstack/swift/commit/c67e56848cec310193f17b4e006948a17006a442
Submitter: Jenkins
Branch: master

commit c67e56848cec310193f17b4e006948a17006a442
Author: Iryoung Jeong <email address hidden>
Date: Mon Jun 18 23:40:50 2012 +0900

    Use buffered gzip stream with python 2.7.

    - Fixes bug 898169.
    - It's possible to make GzipFile inherits io.BufferedIOBase in python
      2.6, but IMO it's better let people to use 2.7 if they really need
      this feature.

    Change-Id: I4c6e4858e3f616af892e7f4fa6daae0f6ee31723