Gnocchi doesn't work with ceph backend

Bug #1718701 reported by haplo37
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Gnocchi Snap
Fix Released
High
James Page
kolla
Fix Released
Critical
haplo37
Pike
Fix Released
Critical
Unassigned

Bug Description

Hi,

When i try to deploy Gnocchi with ceph backend i have this error :

AttributeError: 'rados.Ioctx' object has no attribute 'operate_aio_write_op'

It's not working with ceph backend right now.

Regards,
Farid

Changed in kolla:
assignee: nobody → haplo37 (farid-daencarnacao)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.openstack.org/506251

Changed in kolla:
status: New → In Progress
Revision history for this message
James Page (james-page) wrote :

I'm seeing the same issue with the new gnocchi snap - the ceph version is 10.2.7 which should be good enough so this might point to some inaccurate docs in gnocchi as >= 10.1.0 should be good for python-rados support (rather than cradox).

Changed in snap-gnocchi:
status: New → Triaged
importance: Undecided → High
assignee: nobody → James Page (james-page)
status: Triaged → In Progress
Revision history for this message
James Page (james-page) wrote :

Confirmed; 10.2.x does not have this method, 12.2.0 does.

Revision history for this message
James Page (james-page) wrote :

As you can see in https://github.com/sileht/pycradox/blob/master/cradox.pyx.in; cradox does declare this symbol.

Revision history for this message
James Page (james-page) wrote :

Raised a bug with the gnocchi project as well (deps appear to be inaccurate):

   https://github.com/gnocchixyz/gnocchi/issues/412

Revision history for this message
James Page (james-page) wrote :

How cradox does not appear to work with the librados @10.2.7

Revision history for this message
James Page (james-page) wrote :

Hmm tripped over https://github.com/ceph/ceph/pull/12624 when using cradox with librados@10.2.7

Revision history for this message
James Page (james-page) wrote :

OK so this is a bit narly; cradox does not work for me with 10.2.7, 10.2.9 or 12.2.0:

Oct 05 13:27:00 juju-2758f7-xenial-pike-36 gnocchi.metricd[16316]: /build/ceph-ttzfGl/ceph-12.2.0/src/common/ceph_crypto.cc: In function 'void ceph::crypto::init(CephContext*)' thread 7fe1b905c700 time 2017-10-05 13:27:00.438757
Oct 05 13:27:00 juju-2758f7-xenial-pike-36 gnocchi.metricd[16316]: /build/ceph-ttzfGl/ceph-12.2.0/src/common/ceph_crypto.cc: 71: FAILED assert(crypto_context != __null)

For snaps specifically I'm having trouble getting the pybind built python module to resolve the underlying rados2 library correctly (but that's snap specific).

Revision history for this message
James Page (james-page) wrote :

I've reverted the gnocchi snap to using 3.1.11 which is compatible with the python-rados from Xenial; this still needs to be resolved for >= 4.0.0

Revision history for this message
James Page (james-page) wrote :

I've fixed this by using ceph 12.2.0 from the Pike UCA for the 4.0.x series snap; this is configured as an additional source in the snap autobuilder on launchpad.

I also had todo a slighty nasty shim to deal with the use of librados2 inside of a snap (but at least that works OK).

Changed in snap-gnocchi:
status: In Progress → Fix Released
Changed in kolla:
importance: Undecided → Critical
milestone: none → 5.0.1
milestone: 5.0.1 → queens-1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.openstack.org/506251
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=24f1714a164fb15b1764566d0bb531536ae024d5
Submitter: Zuul
Branch: master

commit 24f1714a164fb15b1764566d0bb531536ae024d5
Author: Farid Da Encarnacao <email address hidden>
Date: Thu Sep 21 11:27:13 2017 -0400

    Fix Gnocchi support ceph

    Based on gnocchi issue #412 [0], cradox is more stable and recommended
    to use.

    * Add cradox for source and RHEL family distro binary.
    * Ubuntu binary lacks of cradox package, so install from pypi

    [0] https://github.com/gnocchixyz/gnocchi/issues/412

    Co-Authored-By: Jeffrey Zhang <email address hidden>
    Change-Id: Icf7d6425884fb889d48c786caebbfc7b7050ae8e
    Closes-Bug: #1718701

Changed in kolla:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/pike)

Reviewed: https://review.openstack.org/523272
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=5b84d8ff7b837034605f58b60ad94c6ec906ccf6
Submitter: Zuul
Branch: stable/pike

commit 5b84d8ff7b837034605f58b60ad94c6ec906ccf6
Author: Farid Da Encarnacao <email address hidden>
Date: Thu Sep 21 11:27:13 2017 -0400

    Fix Gnocchi support ceph

    Based on gnocchi issue #412 [0], cradox is more stable and recommended
    to use.

    * Add cradox for source and RHEL family distro binary.
    * Ubuntu binary lacks of cradox package, so install from pypi

    [0] https://github.com/gnocchixyz/gnocchi/issues/412

    Co-Authored-By: Jeffrey Zhang <email address hidden>
    Change-Id: Icf7d6425884fb889d48c786caebbfc7b7050ae8e
    Closes-Bug: #1718701
    (cherry picked from commit 24f1714a164fb15b1764566d0bb531536ae024d5)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 6.0.0.0b2

This issue was fixed in the openstack/kolla 6.0.0.0b2 development milestone.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 5.0.1

This issue was fixed in the openstack/kolla 5.0.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.