Poller tries to batch all samples in one message

[Sam Morrison]

We've been looking into the central agent and have found some issues running in a large environment.

Currently if batch_polled_samples=True (default) then it will batch up all samples of a poller into one message. This can be problematic if the poller returns a large number of samples.

We are hitting this for the swift pollers as we have over 10k projects and it's trying to fix this in one message. Turning batch_polled_samples off fixes this but it means over 10k messages. Ideally there would be a setting to set a batch size

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/567464

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/567464
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=2dc21a5f05ee670292a8a7f97952d3942c32f5cf
Submitter: Zuul
Branch: master

commit 2dc21a5f05ee670292a8a7f97952d3942c32f5cf
Author: Sam Morrison <email address hidden>
Date: Thu May 10 13:52:04 2018 +1000

    Ability to define batch size off polled samples.

    Currently if batch_polled_samples=True (default) then it will batch
    up all samples of a poller into one message. This can be problematic
    if the poller returns a large number of samples.

    Change-Id: Ifc60a0cb81876f6d9054cae82ba6579707a02f67
    Closes-bug: #1770310

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/ceilometer 11.0.0 release.