nagios ceph-osd-checks fails when running concurrently with COS

Bug #2021507 reported by Giuseppe Petralia
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ceph OSD Charm
Fix Committed
Medium
Unassigned

Bug Description

This check is based on cache which is invalidated on any execution of the check and populated by a cron job.

If we have nagios and COS running concurrently this check always fails, given it assumes that the cache is always invalid.

Tags: bseng-1233
tags: added: bseng-1233
Revision history for this message
Billy Olsen (billy-olsen) wrote :

Is this the same as bug #2019251 ?

Revision history for this message
Giuseppe Petralia (peppepetra) wrote :

This is only happening when there are two entities (in this case Nagios and COS Prometheus) running the check concurrently.

description: updated
Revision history for this message
Peter Sabaini (peter-sabaini) wrote :

Triaging as Medium.

We may need to examine the cache invalidation logic for Bug #2019251 as well

Changed in charm-ceph-osd:
status: New → Triaged
importance: Undecided → Medium
Changed in charm-ceph-osd:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-ceph-osd (master)

Reviewed: https://review.opendev.org/c/openstack/charm-ceph-osd/+/900563
Committed: https://opendev.org/openstack/charm-ceph-osd/commit/1494d9a24527769064b819d5e1da4fdaebf6dcd2
Submitter: "Zuul (22348)"
Branch: master

commit 1494d9a24527769064b819d5e1da4fdaebf6dcd2
Author: Pedro Castillo <email address hidden>
Date: Thu Nov 9 15:50:44 2023 -0600

    Refactor cache validation for the ceph-osd NRPE check

    Closes-Bug: #2019251
    Closes-Bug: #2021507
    Change-Id: Ib50414756165f2587f0127e572675c7ca8e31ef9

Changed in charm-ceph-osd:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-ceph-osd (stable/quincy.2)

Fix proposed to branch: stable/quincy.2
Review: https://review.opendev.org/c/openstack/charm-ceph-osd/+/902885

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-ceph-osd (stable/quincy.2)

Reviewed: https://review.opendev.org/c/openstack/charm-ceph-osd/+/902885
Committed: https://opendev.org/openstack/charm-ceph-osd/commit/e0459f1e2851a592180aa304bb56230fa9a98f38
Submitter: "Zuul (22348)"
Branch: stable/quincy.2

commit e0459f1e2851a592180aa304bb56230fa9a98f38
Author: Pedro Castillo <email address hidden>
Date: Thu Nov 9 15:50:44 2023 -0600

    Refactor cache validation for the ceph-osd NRPE check

    Also update test env, remove zed testing

    Closes-Bug: #2019251
    Closes-Bug: #2021507
    Change-Id: Ib50414756165f2587f0127e572675c7ca8e31ef9
    (cherry picked from commit 1494d9a24527769064b819d5e1da4fdaebf6dcd2)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.