400.002: Controller-services group has no members; 2 controllers online

[Brendan McShane]

After installing StarlingX AIO duplex, an alarm stating "400.002 | Service group controller-services has no active members available; expected 1 active member" appears. There are two controllers in the cluster that are currently online. I suspect that this may be caused by the `controller-services` group having the state `go-active` instead of the expected state `active`.

Thanks in advance!

[Eliud Kyale (ekyale)]

Brendan can you collect logs on the system and attach to this Bug

See: https://docs.starlingx.io/fault-mgmt/kubernetes/troubleshooting-log-collection.html

[Brendan McShane (bman46)]

Sure, i'll attach the logs. I did some experimenting and found that this occurs when ceph-rook is used instead of ceph. It appears to be caused by the `rook-mon-exit` service being stuck in the `initial` state. I should also note that the helm chart does not appear under `system application-list`. When I reinstalled without rook, the deployment completed successfully.

[Brendan McShane (bman46)]

Just tried this again with stx V9 and the `controller-services` group is also stuck in the `go-active` state. Similarly, the Rook helm chart was not uploaded and the `rook-mon-exit` service is in the `initial` state.

[Brendan McShane (bman46)]

After downloading the rook-mon-exit.sh script from https://opendev.org/starlingx/rook-ceph/src/branch/r/stx.9.0/stx-rook-ceph/files, moving it to `/etc/init.d/rook-mon-exit` and running `sudo sm-restart rook-mon-exit` I was able to get the alarm cleared and controller-services in the active state.

It appears rook-ceph is not installed by default? https://opendev.org/starlingx/rook-ceph/src/branch/r/stx.9.0/debian_iso_image.inc Any reason it appears to be disabled?

[Ghada Khalil (gkhalil)]

@Renata, can you please answer the questions related to ceph rook? Thanks

[Luiz Felipe Kina (leiskeki)]

Rook-ceph is not available and functional on stx 9.0 that is why it is not installed by default, it will be available and functioning starting on stx 10.