pymongo 2.6 causes memory leak

[Evgeniy Afonichev]

The original issue https://bugs.launchpad.net/oslo.messaging/+bug/1372835
The fix proposed https://review.openstack.org/#/c/123995/ (not yet merged)
Please note it's in openstack/requirements component

In my case this issue affects ceilometer

"During execution of long term stability test it was found that the memory usage for the ceilometer-collector has been increasing steadily. For the RSS and the VSZ memory respectively the following increase values have been found. RSS increased by nearly 300% and VSZ by near to 200%"

We tested that fix and it solves the problem with memory leakage

Version: 5.1.2

[Dmitry Mescheryakov (dmitrymex)]

We need to have pymongo >= 2.6.1 to be not affected by the bug. Right now we have
 * 2.5.2 for CentOS
 * not sure what for Ubuntu Trusty

Lets update CentOS's package, and probably we will get proper update from Trusty automatically

[Ivan Berezovskiy (iberezovskiy)]

We have pymongo 2.6.1 for Ubuntu 12.04 (Fuel 5.1.2) and pymongo 2.6.3 for Ubuntu 12.04 (Fuel 6.0.1 and 6.1). Need to update pymongo for CentOS only because RPM version is 2.5.2 for 5.1.2, 6.0.1 and 6.1 releases.

[OSCI Robot (oscirobot)]

package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4248
project: packages/centos6/pymongo
branch: 6.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-4248/

[OSCI Robot (oscirobot)]

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4249
project: packages/centos6/pymongo
branch: 6.0.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-4249/centos

[OSCI Robot (oscirobot)]

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4250
project: packages/centos6/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-4250/centos

[Ivan Berezovskiy (iberezovskiy)]

Fixes are merged for 5.1.2, 6.0.1 and 6.1

[OSCI Robot (oscirobot)]

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4249
project: packages/centos6/pymongo
branch: 6.0.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable/centos

[OSCI Robot (oscirobot)]

package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4248
project: packages/centos6/pymongo
branch: 6.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /centos-fuel-6.1-stable/

[OSCI Robot (oscirobot)]

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4250
project: packages/centos6/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable/centos

[Aleksey Zvyagintsev (azvyagintsev)]

Hm, what about update this package in ubuntu-fuel-5.1.2-stable ?
Becouse currently in 5.1.2 they still python-pymongo_2.6-1~cloud1_amd64.deb

(https://osci-obs.vm.mirantis.net/package/show?package=pymongo&project=ubuntu-fuel-5.1.2-stable agregated from https://osci-obs.vm.mirantis.net/package/show?package=pymongo&project=ubuntu-cloud:havana ).
I think fix uncompleted.

[Ivan Berezovskiy (iberezovskiy)]

We need to have pymongo >= 2.6.1 to be not affected by the bug, so version for ubuntu is suitable.

[Ivan Berezovskiy (iberezovskiy)]

It was decided to update pymongo for Ubuntu in Fuel 5.1.2 (to use the same version as for CentOS). Change is here https://review.fuel-infra.org/#/c/4317/

[OSCI Robot (oscirobot)]

DEB package pymongo has been built for project packages/precise/pymongo
Package version == , package release ==

Changeset: https://review.fuel-infra.org/4317
project: packages/precise/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update pymongo to 2.6.3 for Fuel 5.1.2
status: patchset-created

Files placed on repository:
python-bson-ext_2.6.3-1build1_amd64.deb
python-bson_2.6.3-1build1_amd64.deb
python-gridfs_2.6.3-1build1_all.deb
python-pymongo-doc_2.6.3-1build1_all.deb
python-pymongo-ext_2.6.3-1build1_amd64.deb
python-pymongo_2.6.3-1build1_amd64.deb
python3-bson-ext_2.6.3-1build1_amd64.deb
python3-bson_2.6.3-1build1_amd64.deb
python3-gridfs_2.6.3-1build1_all.deb
python3-pymongo-ext_2.6.3-1build1_amd64.deb
python3-pymongo_2.6.3-1build1_amd64.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: /ubuntu-fuel-5.1.2-stable-4317/ubuntu

[OSCI Robot (oscirobot)]

DEB package pymongo has been built for project packages/precise/pymongo
Package version == , package release ==

Changeset: https://review.fuel-infra.org/4317
project: packages/precise/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update pymongo to 2.6.3 for Fuel 5.1.2
status: change-merged

Files placed on repository:
python-bson-ext_2.6.3-1build1_amd64.deb
python-bson_2.6.3-1build1_amd64.deb
python-gridfs_2.6.3-1build1_all.deb
python-pymongo-doc_2.6.3-1build1_all.deb
python-pymongo-ext_2.6.3-1build1_amd64.deb
python-pymongo_2.6.3-1build1_amd64.deb
python3-bson-ext_2.6.3-1build1_amd64.deb
python3-bson_2.6.3-1build1_amd64.deb
python3-gridfs_2.6.3-1build1_all.deb
python3-pymongo-ext_2.6.3-1build1_amd64.deb
python3-pymongo_2.6.3-1build1_amd64.deb

Changeset merged. Package placed on primary repository
DEB repository URL: /ubuntu-fuel-5.1.2-stable/ubuntu

[Vadim Rovachev (vrovachev)]

verified on:
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  api: "1.0"
  build_number: "178"
  build_id: "2015-03-09_22-54-44"
  nailgun_sha: "a9a6578a649a2a006c4810b3d0aa6876ac6e8b83"
  python-fuelclient_sha: "4eb787f1ad969bd23c93d192865543dbd45a8626"
  astute_sha: "2d61ee42ec6dae3181d292c7769d32e40d463893"
  fuellib_sha: "62e68af896887ebe18944e6a0a9721e269119ad4"
  ostf_sha: "8df5f2fcdae3bc9ea7d700ffd64db820baf51914"
  fuelmain_sha: "c73b87f7cbc371307a21c368a45a65aa3f4b7a5d"

[Evgeniy Afonichev (eafonichev)]

JFYI, today the original fix was merged finally https://review.openstack.org/#/c/123995/

[OSCI Robot (oscirobot)]

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4969
project: packages/centos6/pymongo
branch: 6.0-updates
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable-4969/centos

[OSCI Robot (oscirobot)]

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4969
project: packages/centos6/pymongo
branch: 6.0-updates
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable/centos