Feature request: set 'interval' in pipeline.yaml

[Xav Paice]

I have a customer asking for the collection interval for pollster data to be set to 30 mins rather than the default 10 mins. The charm doesn't currently expose this setting, which is located in multiple places in /etc/ceilometer/pipeline.yaml named 'interval' in each place.

[Frode Nordahl (fnordahl)]

1) How often/in how many use cases do you anticipate it will be necessary to adjust these values?
2) Would you require fine grained control over interval values for individual sources or would it be sufficient and useful to be able to change all of them with one parameter?

[Xav Paice (xavpaice)]

Hi,

Responding to Frode's query:
1) At least one customer who currently depends on Ceilometer is asking for this right now, but I can't really guess how many future customers would want this. It might be worth asking around on the ops mailing list if we're trying to work out if the effort is worth it for a one off. What I can say is that the customer asking for this doesn't have capacity for the retention they want with the default 10 min interval, and the setting is provided in Ceilometer itself so should be exposed via charm if we want to avoid hacky workarounds.

2) The request I've got from the customer was a single setting for all sources - and I would expect that to be the most logical approach when querying the resulting data sets.

Thanks for looking into this!

[Xav Paice (xavpaice)]

Default for Queens is now 5 mins rather than 10.

See https://bugs.launchpad.net/charm-ceilometer/+bug/1785933 which likely means adding polling.yaml in any case, making this an easy one to implement.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/18.05
Review: https://review.openstack.org/589720

[Alex Kavanagh (ajkavanagh)]

This one is held up because, in order to patch the stable/18.05 charms, we need to put the feature into master and patch stable/18.11, stable/18.08 as well as stable/18.05. This is because if an operator upgrades their charms it shouldn't break the functionality; i.e. as it stands now, there would be a regression if the op upgraded from stable/18.05 to any newer charm.

Please could a separate review be raised for master with the feature, and once that has landed, it can be backported using a cherry-pick to 18.11, 18.08 and then 18.05.

Thanks.

[Ryan Beisner (1chb1n)]

Thank you for your work on this.

To be clear, we will not likely port this back to the 18.05 stable charms. We maintain the latest stable charm branch (18.11 currently). The changes need to be landed into the master branch first. Then, a backport to the current stable branch (18.11) can be proposed or requested.

I see recent changes proposed against master regarding this bug:

https://review.openstack.org/#/c/589697/

Awaiting a full check of the func tests.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Xav Paice (<email address hidden>) on branch: stable/18.05
Review: https://review.openstack.org/589720
Reason: way outdated! Thanks

[Xav Paice (xavpaice)]

Thanks, I think it's better to update the charms on site to 18.11 (or later, depending on when this lands), and have abandoned the ancient change.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/589697
Committed: https://git.openstack.org/cgit/openstack/charm-ceilometer/commit/?id=2baf36f4eeca6fad7202f1e914d893619f5569a6
Submitter: Zuul
Branch: master

commit 2baf36f4eeca6fad7202f1e914d893619f5569a6
Author: Xav Paice <email address hidden>
Date: Wed Aug 8 15:25:27 2018 +1200

    Add polling.yaml to managed configs

    This change adds polling.yaml to the list of managed config files, for
    Queens and above. Two new config items are added alongside the
    template, to take into account a choice between the two polling.yaml
    files supplied with the Ceilometer source, one which has a small list of
    pollsters and the other which has all pollsters. Additionally the
    change adds the option to set the polling interval.

    Change-Id: Ifff72870cf79bea23dbd21586857dd832c9e1405
    Closes-Bug: 1785933
    Closes-Bug: 1652848