"RBD Overview" and "RBD details" dashboards are all empty

Bug #1989648 reported by Yoshi Kadokawa
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ceph Dashboard Charm
In Progress
Undecided
Yoshi Kadokawa

Bug Description

"RBD Overview" and "RBD details" dashboards in Grafana are all empty as you can see in the attached screenshot.
Because of this "Overall performance" in Ceph Dashboard => Block => Images
is also empty.

The environment is OpenStack Yoga + Ceph Quincy on Ubuntu Focal.
I have confirmed that there are several pools been created but no rbd_stats_pools[0] is configured.

$ sudo ceph osd pool ls
.mgr
default.rgw.buckets.data
default.rgw.control
default.rgw.data.root
default.rgw.gc
default.rgw.log
default.rgw.intent-log
default.rgw.meta
default.rgw.otp
default.rgw.usage
default.rgw.users.keys
default.rgw.users.email
default.rgw.users.swift
default.rgw.users.uid
default.rgw.buckets.extra
default.rgw.buckets.index
.rgw.root
glance
cinder-ceph

$ sudo ceph config get mgr mgr/prometheus/rbd_stats_pools
<empty>

This can be workarounded by conifugring the following. (Adding cinder-ceph and glance for example)

$ sudo ceph config set mgr mgr/prometheus/rbd_stats_pools "cinder-ceph,glance"

Then the dashboards in Grafana will show with data.
However, for the dashboards in the Ceph Dashboard, you will need to workaround because of the other bug[1].

Steps to reproduce:
juju deploy openstack-base
juju deploy ceph-dashboard --channel quincy/stable
juju deploy telegraf
juju deploy grafana
juju deploy prometheus2 prometheus

juju config telegraf hostname="{host}"
juju config grafana anonymous=True
juju config grafana allow_embedding=True
juju config grafana install_plugins="https://storage.googleapis.com/plugins-community/vonage-status-panel/release/1.0.11/vonage-status-panel-1.0.11.zip,https://storage.googleapis.com/plugins-community/grafana-piechart-panel/release/1.6.2/grafana-piechart-panel-1.6.2.zip"

GRAFANA_IP=$(juju run --unit grafana/leader \
  "network-get --bind-address website")
juju config ceph-dashboard grafana-api-url=https://${GRAFANA_IP}:3000

juju add-relation ceph-dashboard:certificates vault:certificates
juju add-relation grafana:certificates vault:certificates
juju add-relation grafana:grafana-source prometheus:grafana-source
juju add-relation telegraf:prometheus-client prometheus:target
juju add-relation telegraf:dashboards grafana:dashboards
juju add-relation ceph-dashboard:dashboard ceph-mon:dashboard
juju add-relation ceph-dashboard:grafana-dashboard grafana:dashboards
juju add-relation ceph-dashboard:prometheus prometheus:website
juju add-relation ceph-dashboard:radosgw-dashboard ceph-radosgw:radosgw-user
juju add-relation ceph-mon:prometheus prometheus:target
juju add-relation ceph-osd:juju-info telegraf:juju-info
juju add-relation ceph-mon:juju-info telegraf:juju-info

[0] https://docs.ceph.com/en/latest/mgr/prometheus/#prometheus-rbd-io-statistics
[1] https://bugs.launchpad.net/charm-ceph-dashboard/+bug/1982537

Revision history for this message
Yoshi Kadokawa (yoshikadokawa) wrote :
Changed in charm-ceph-dashboard:
status: New → In Progress
assignee: nobody → Yoshi Kadokawa (yoshikadokawa)
Revision history for this message
Yoshi Kadokawa (yoshikadokawa) wrote :

Screenshot after applying the fix.

Revision history for this message
Yoshi Kadokawa (yoshikadokawa) wrote :

Screenshot of RBD details after applying the fix

Revision history for this message
Yoshi Kadokawa (yoshikadokawa) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-ceph-dashboard (stable/quincy)

Fix proposed to branch: stable/quincy
Review: https://review.opendev.org/c/openstack/charm-ceph-dashboard/+/859910

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on charm-ceph-dashboard (stable/quincy)

Change abandoned by "Yoshi Kadokawa <email address hidden>" on branch: stable/quincy
Review: https://review.opendev.org/c/openstack/charm-ceph-dashboard/+/859910

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.