Ceilometer Pike packages should require python-jsonpath-rw-ext 1.1.2 on 16.04

[Cory Wright]

I'm using the Ubuntu Cloud Archive to install Pike packages on 16.04.

With the default configuration of Ceilometer and Gnocchi I am seeing the following message when trying to process metrics from Keystone:

    WARNING ceilometer.dispatcher.gnocchi [-] metric $.payload.outcome - $.payload.outcome + 'identity.authenticate.' + $.payload.outcome is not handled by Gnocchi

These metrics from Keystone are never received by Gnocchi.

When I asked about this on the #openstack-telemetry IRC channel the developers found that this message is the result of an older version of the python-jsonpath-rw-ext package being installed from the Pike Cloud Archive. The xenial-updates/pike Ubuntu Cloud Archive repository has version 0.1.9 of python-jsonpath-rw-ext, where the developers suggest that version 1.1.3 is needed [1]. Specifically, this is required for the `identity.authenticate` event_type defined in the default packaged version of /usr/lib/python2.7/dist-packages/ceilometer/data/meters.d/meters.yaml.

It appears the 1.1.3 packages for python-jsonpath-rw-ext are already present in the Queens archive [2]. Could these be made available in the Pike repository as well?

1. http://eavesdrop.openstack.org/irclogs/%23openstack-telemetry/%23openstack-telemetry.2018-07-03.log.html#t2018-07-03T14:05:35
2. http://ubuntu-cloud.archive.canonical.com/ubuntu/pool/main/p/python-jsonpath-rw-ext/

[Corey Bryant (corey.bryant)]

Hi Cory,

Thanks for reporting this.

Upper-constraints for stable/pike has 1.1.2.
https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt

In general we're very conservative with introducing any new features to stable releases. We may instead need to backport specific patches to enable whatever it is that's needed. I'll take a look.

Thanks,
Corey

[Corey Bryant (corey.bryant)]

Here's a brief diff of commits between 0.1.9 and 1.1.2:

 - [942761a] Allow to skip tests
 - [81618fd] Remove unused Babel dependency
 - [edcfe4c] Use modern PBR and hacking packages
 - [dec2609] Update release script and fix doc
 - [f440518] PEP8 - line length
 - [1a31c9a] Added support for boolean values in filters
 - [42cfd7c] Fix pep8
 - [5e8e524] Make results of a sort indexable and traversable
 - [741ddbe] Added support for floating point types in filter predicates
 - [da3e74d] Fix error when the filtered datum is not iterable
 - [4c667b8] Set minimum version of jsonpath-rw
 - [1b35fff] Fix reference to jsonpath-rw

[Corey Bryant (corey.bryant)]

Only gabbi and ceilometer depend on python(3)-jsonpath-rw-ext:

$ apt rdepends python-jsonpath-rw-ext
python-jsonpath-rw-ext
Reverse Depends:
  Depends: python-ceilometer (>= 0.1.9)
  Depends: python-ceilometer (>= 0.1.9)
  Depends: python-gabbi

Considering that only gabbi and ceilometer depend on this package and stable/pike upper-constraints is at 1.1.2, I think this is worthy of backporting 1.1.2 to the Pike cloud archive.

[Corey Bryant (corey.bryant)]

Hello Cory, or anyone else affected,

Accepted python-jsonpath-rw-ext into pike-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:pike-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-pike-needed to verification-pike-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-pike-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Corey Bryant (corey.bryant)]

Hi Cory, by any chance can you verify that this is fixed in pike-proposed?

[Corey Bryant (corey.bryant)]

The verification of the Stable Release Update for python-jsonpath-rw-ext has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

[Corey Bryant (corey.bryant)]

pike-updates now has 1.1.2-0ubuntu0.17.10.1~cloud0