Unable to redefine a ceph monitor
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Medium
|
Tingjie Chen |
Bug Description
Brief Description
-----------------
Ceph monitor provisioning does not get deleted when the ceph monitor node is deleted.
Severity
--------
Major
Steps to Reproduce
------------------
1. On a 2+2 system, lock and delete compute-0. This leaves two ceph monitors: controller-0 and controller-1.
2. Provision one of the remaining computes as the new ceph monitor by locking the node and running system ceph-mon-add <nodename>, unlock the host
3. Once the host unlocks, check ceph -s. You'll see the following:
[wrsroot@
cluster d31d9359-
health HEALTH_WARN
1 mons down, quorum 0,1,3 controller-
monmap e3: 4 mons at {compute-
osdmap e62: 2 osds: 2 up, 2 in
flags sortbitwise,
pgmap v86548: 1048 pgs, 12 pools, 3295 MB data, 4224 objects
6520 MB used, 3340 GB / 3347 GB avail
client io 188 B/s rd, 384 kB/s wr, 0 op/s rd, 76 op/s wr
Ceph is in HEALTH_WARN state and thinks there should be 4 monitors instead of 3.
Expected Behavior
------------------
There should be 3 monitors: controller-0, controller-1 and compute-1. The deleted node should not appear as a monitor.
Actual Behavior
----------------
The deleted node appears as a monitor.
Reproducibility
---------------
Reproducible
System Configuration
-------
Standard 2 controller + 2 compute system
Branch/Pull Time/Commit
-------
Master build: 20190427T013000Z
Last Pass
---------
New feature
Timestamp/Logs
--------------
N/A. Easy to reproduce.
Test Activity
-------------
Feature Testing
Changed in starlingx: | |
assignee: | Cindy Xie (xxie1) → Tingjie Chen (silverhandy) |
tags: | added: stx.storage |
Changed in starlingx: | |
status: | Triaged → In Progress |
tags: | added: stx.distro.other |
tags: | removed: stx.distro.other |
Changed in starlingx: | |
status: | Fix Released → Confirmed |
tags: | removed: stx.retestneeded |
Marking stx.2.0 gating as ceph functionality is required for all StarlingX configurations.
Assigning to Cindy and request assistance to identify a prime to investigate this issue.