[2.9.29] Juju HA shows as "None"

[Peter Jose De Sousa]

Hello,

When deploying juju in HA on 2.9.29 my nodes will enter a ready state, but HA will show as None on the juju controllers page. Rebooting the primary controller will force the status from None to 3.

To reproduce:

juju bootstrap localhost lxd-lcl-controller
juju add-machine -m controller -n 2
juju enable-ha --to 1,2

observe juju status -m controller --format json wait for nodes to enter "running".

Run juju controllers

Observe controller HA is "None".

[Workaround]

juju show-controller

Find the HA primary:

  controller-machines: [6/1657]
    "0":
      instance-id: juju-4fe7ec-0
      ha-status: ha-enabled
      ha-primary: true
PRIMARY=0
juju ssh -m $PRIMARY -- sudo reboot

Observe that HA is now 3:

lxd-lcl-controller* default admin superuser localhost/localhost 2 3 3 2.9.29

Thank you,

Peter

[Peter Jose De Sousa (pjds)]

subscribing field medium, as there is a workaround

[Peter Jose De Sousa (pjds)]

after reviewing the SLA, bumping to field-high due to the nature of the control plane issue.

[Vitaly Antonenko (anvial)]

Hi Peter,

I cannot reproduce your case.
Here is my paste: https://pastebin.ubuntu.com/p/bQtFRs5Qps/

Seems that HA is enabled correctly.

Could you help to reproduce it?

[Peter Jose De Sousa (pjds)]

hey Vitaly,

When you run juju controllers, does it show "None"? I could not see from your pastebin

[Vitaly Antonenko (anvial)]

What do you mean by `run juju controllers`?

Here is the output of `juju status -m controller --format json`
```
{
  "model": {
    "name": "controller",
    "type": "iaas",
    "controller": "lxd",
    "cloud": "localhost",
    "region": "localhost",
    "version": "2.9.29",
    "model-status": {
      "current": "available",
      "since": "13 May 2022 13:53:26+03:00"
    },
    "sla": "unsupported"
  },
  "machines": {
    "0": {
      "juju-status": {
        "current": "started",
        "since": "13 May 2022 13:53:32+03:00",
        "version": "2.9.29"
      },
      "hostname": "juju-d1e459-0",
      "dns-name": "10.209.4.168",
      "ip-addresses": [
        "10.209.4.168"
      ],
      "instance-id": "juju-d1e459-0",
      "machine-status": {
        "current": "running",
        "message": "Running",
        "since": "13 May 2022 13:53:43+03:00"
      },
      "modification-status": {
        "current": "idle",
        "since": "13 May 2022 13:53:26+03:00"
      },
      "series": "focal",
      "network-interfaces": {
        "eth0": {
          "ip-addresses": [
            "10.209.4.168"
          ],
          "mac-address": "00:16:3e:ca:9a:70",
          "gateway": "10.209.4.1",
          "space": "alpha",
          "is-up": true
        }
      },
      "hardware": "arch=amd64 cores=0 mem=0M",
      "controller-member-status": "has-vote",
      "ha-primary": true
    },
    "1": {
      "juju-status": {
        "current": "started",
        "since": "13 May 2022 13:55:33+03:00",
        "version": "2.9.29"
      },
      "hostname": "juju-d1e459-1",
      "dns-name": "10.209.4.50",
      "ip-addresses": [
        "10.209.4.50"
      ],
      "instance-id": "juju-d1e459-1",
      "machine-status": {
        "current": "running",
        "message": "Running",
        "since": "13 May 2022 13:54:55+03:00"
      },
      "modification-status": {
        "current": "idle",
        "since": "13 May 2022 13:54:43+03:00"
      },
      "series": "focal",
      "network-interfaces": {
        "eth0": {
          "ip-addresses": [
            "10.209.4.50"
          ],
          "mac-address": "00:16:3e:0b:0a:6a",
          "gateway": "10.209.4.1",
          "space": "alpha",
          "is-up": true
        }
      },
      "hardware": "arch=amd64 cores=0 mem=0M",
      "controller-member-status": "adding-vote"
    },
    "2": {
      "juju-status": {
        "current": "started",
        "since": "13 May 2022 13:55:35+03:00",
        "version": "2.9.29"
      },
      "hostname": "juju-d1e459-2",
      "dns-name": "10.209.4.143",
      "ip-addresses": [
        "10.209.4.143"
      ],
      "instance-id": "juju-d1e459-2",
      "machine-status": {
        "current": "running",
        "message": "Running",
        "since": "13 May 2022 13:54:55+03:00"
      },
      "modification-status": {
        "current": "idle",
        "since": "13 May 2022 13:54:43+03:00"
      },
      "series": "focal",
      "network-interfaces": {
        "eth0": {
          "ip-addresses": [
            "10.209.4.143"
          ],
          "mac-address": "00:16:3e:b2:38:4f",
          "gateway": "10.209.4.1",
          "space": "alpha",
          "is-up":...

[Heather Lanigan (hmlanigan)]

@pjds, did you run juju controllers --refresh, after enable-ha? juju controllers data is not automatically refreshed, but comes from local data.

[Heather Lanigan (hmlanigan)]

interesting, running juju show-controller did cause the juju controllers local data to refresh.

[Peter Jose De Sousa (pjds)]

@heather I did not, that is a good point, I can try that again next time and see if it has any effect

[Peter Jose De Sousa (pjds)]

hello @Heather, running refresh didnt make a difference in my case, but I believe this issue is now resvolved in later versions.