ceilometer service is working on a single thread

Bug #1291054 reported by gordon chung
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ceilometer
Fix Released
High
gordon chung

Bug Description

ceilometer collector is working off a single thread. this makes processing data very slow... this explans why, we don't see any QueuePool issues because we only ever have one connection writing to the db.

***The best option is here it to spawn multiple processes. Oslo's services.py should support that, but I never took the time to work on that.***

gordon chung (chungg)
Changed in ceilometer:
importance: Critical → High
gordon chung (chungg)
summary: - ceilometer collector is working on a single thread
+ ceilometer service is working on a single thread
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to ceilometer (master)

Fix proposed to branch: master
Review: https://review.openstack.org/79790

Changed in ceilometer:
assignee: nobody → gordon chung (chungg)
status: New → In Progress
gordon chung (chungg)
description: updated
Revision history for this message
Julien Danjou (jdanjou) wrote :

Welcome to Python. Nothing is thread safe, and performances in Python of real system threads are terrible. Greenthreads that we used to be via monkey patching are introducing bugs in some drivers (like Cassandra).

The best option is here it to spawn multiple processes. Oslo's services.py should support that, but I never took the time to work on that.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/79962

gordon chung (chungg)
description: updated
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to ceilometer (master)

Reviewed: https://review.openstack.org/79962
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=0f038d2fe22edacb576e2fa82e4243f229098bd0
Submitter: Jenkins
Branch: master

commit 0f038d2fe22edacb576e2fa82e4243f229098bd0
Author: Gordon Chung <email address hidden>
Date: Wed Mar 12 10:58:20 2014 -0400

    spawn multiple workers in services

    the collector service only ever grabs one connection to the
    database at a time. this causes a massive backlog on the message
    queue. enable ability to spawn multiple workers for notification
    and collector services.

    Change-Id: Ie85c4a6eace52c771c3eb8425839d253f8dd74cd
    Closes-Bug: #1291054

Changed in ceilometer:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in ceilometer:
milestone: none → icehouse-rc1
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in ceilometer:
milestone: icehouse-rc1 → 2014.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.