gnocchi-statsd directory does not exist

[James Shelby]

Enabling gnocchi and then deploying errors with gnocchi-statsd directory does not exist.

Manually creating this directory before doing the deploy on the controllers seems to resolve.

There should be something in kolla-ansible that sets this up.

[James Shelby (shelbytek)]

I take that back. Gnocchi still will not deploy as there are issues.

[Mark Goddard (mgoddard)]

I think this patch fixes the issue, but the author needs to update it: https://review.opendev.org/c/openstack/kolla-ansible/+/782916

[James Shelby (shelbytek)]

To focus on the gnocchi bug I modified the external_ceph.yml with the configuration you specified.

I enabled both gnocchi and gnocchi_statsd in the globals.yml like this:
enable_gnocchi: "yes"
enable_gnocchi_statsd: "yes"

However when I reconfigure it locks up at the gnocchi bootstrap process as seen here:

TASK [gnocchi : Creating gnocchi database] **************************************************************************************************************************************************************************************************
ok: [control1 -> control1]

TASK [gnocchi : Creating gnocchi database user and setting permissions] *********************************************************************************************************************************************************************
ok: [control1 -> control1]

TASK [gnocchi : Running gnocchi bootstrap container] ****************************************************************************************************************************************************************************************

[James Shelby (shelbytek)]

It may be related to this and investigating but I'm on wallaby.

https://bugs.launchpad.net/kolla-ansible/+bug/1886711

[James Shelby (shelbytek)]

Definitely not related to that bug as the kolla-ansible already has the fix in place

[James Shelby (shelbytek)]

According to the logs in the gnocchi-api container it is:

2021-05-06 07:45:45,670 [21] ERROR gnocchi.utils: Unable to initialize storage driver
Traceback (most recent call last):
  File "/var/lib/kolla/venv/lib/python3.6/site-packages/tenacity/__init__.py", line 426, in __call__
    result = fn(*args, **kwargs)
  File "/var/lib/kolla/venv/lib/python3.6/site-packages/gnocchi/storage/__init__.py", line 102, in get_driver
    conf.storage)
  File "/var/lib/kolla/venv/lib/python3.6/site-packages/gnocchi/storage/ceph.py", line 52, in __init__
    self.rados, self.ioctx = ceph.create_rados_connection(conf)
  File "/var/lib/kolla/venv/lib/python3.6/site-packages/gnocchi/common/ceph.py", line 46, in create_rados_connection
    raise ImportError("No module named 'rados'")
ImportError: No module named 'rados'

This appears to be due to the python3-rados and dependencies missing from the container.

[James Shelby (shelbytek)]

The problem appears to be the kolla/gnocchi-api image is missing the dependencies it needs so this might be a ticket for the kolla side.

[Mark Goddard (mgoddard)]

Here is the kolla bug: https://bugs.launchpad.net/kolla/+bug/1927756

[Mark Goddard (mgoddard)]

Proposed fix: https://review.opendev.org/c/openstack/kolla-ansible/+/782916/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/782916
Committed: https://opendev.org/openstack/kolla-ansible/commit/6230971b9297f67ff92e61a9a6e9203b499d6587
Submitter: "Zuul (22348)"
Branch: master

commit 6230971b9297f67ff92e61a9a6e9203b499d6587
Author: Christian Berendt <email address hidden>
Date: Thu Mar 25 09:34:28 2021 +0100

    gnocchi: fix external ceph integration when gnocchi-statsd is disabled

    Closes-Bug: #1926914

    Change-Id: I7f472a27eb9f2e1f267d7c4bac22236cdd076322

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 13.0.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/853439

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/853439
Committed: https://opendev.org/openstack/kolla-ansible/commit/0c53d56fa6db9d5a59dc0f37f4d0fa950a02692e
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 0c53d56fa6db9d5a59dc0f37f4d0fa950a02692e
Author: Christian Berendt <email address hidden>
Date: Thu Mar 25 09:34:28 2021 +0100

    gnocchi: fix external ceph integration when gnocchi-statsd is disabled

    Closes-Bug: #1926914

    Change-Id: I7f472a27eb9f2e1f267d7c4bac22236cdd076322
    (cherry picked from commit 6230971b9297f67ff92e61a9a6e9203b499d6587)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 12.7.0 release.