Controller Commissioning status is Failed

[Marian Gasparovic]

MAAS 3.2.11 testing

During MAAS setup we wait for controllers to have commissioning status Passed. However we encountered two test runs where at least one controller reported Failed status

2024-05-16-13:53:07 root DEBUG [localhost]: maas root rack-controllers read
2024-05-16-13:53:12 foundationcloudengine.layers.configuremaas INFO Controller infra1: Commissioning status is Passed
2024-05-16-13:53:12 foundationcloudengine.layers.configuremaas INFO Controller infra2: Commissioning status is Passed
2024-05-16-13:53:12 foundationcloudengine.layers.configuremaas INFO Controller infra3: Commissioning status is Failed

Link to logs and artifacts
- https://oil-jenkins.canonical.com/artifacts/78e84027-f246-4dbb-a02f-12e9408fc41b/index.html

- https://oil-jenkins.canonical.com/artifacts/60b9ba60-7adb-4f55-b33b-5b4a585e65d1/index.html

[Mauricio Faria de Oliveira (mfo)]

@ https://oil-jenkins.canonical.com/artifacts/78e84027-f246-4dbb-a02f-12e9408fc41b/fce_build_layer_30353/fce_build_layer_30353_maas_console.out

2024-05-16-13:53:07 fce.maas INFO Starting step: maas:wait_for_controllers
2024-05-16-13:53:07 root DEBUG [localhost]: maas root rack-controllers read
2024-05-16-13:53:12 foundationcloudengine.layers.configuremaas INFO Controller infra1: Commissioning status is Passed
2024-05-16-13:53:12 foundationcloudengine.layers.configuremaas INFO Controller infra2: Commissioning status is Passed
2024-05-16-13:53:12 foundationcloudengine.layers.configuremaas INFO Controller infra3: Commissioning status is Failed

@ https://oil-jenkins.canonical.com/artifacts/60b9ba60-7adb-4f55-b33b-5b4a585e65d1/fce_build_layer_30316/fce_build_layer_30316_maas_console.out

2024-05-16-10:01:28 fce.maas INFO Starting step: maas:wait_for_controllers
2024-05-16-10:01:28 root DEBUG [localhost]: maas root rack-controllers read
2024-05-16-10:01:32 foundationcloudengine.layers.configuremaas INFO Controller noma: Commissioning status is Passed
2024-05-16-10:01:32 foundationcloudengine.layers.configuremaas INFO Controller sunset: Commissioning status is Failed

[Seyeong Kim (seyeongkim)]

I'm taking a look at the logs but nothing special except this.

https://pastebin.canonical.com/p/m92hBbPqdm/

how many times have you tried to run test?

let me check the error..

[Seyeong Kim (seyeongkim)]

Today, I built FCE environment in my local(with MAAS 3.2/edge ), it is slow but passed commissioning status.

2024-05-22-08:15:58 foundationcloudengine.layers.configuremaas INFO Controller infra2: Commissioning status is Passed
2024-05-22-08:15:58 foundationcloudengine.layers.configuremaas INFO Controller infra3: Commissioning status is Passed
2024-05-22-08:15:58 foundationcloudengine.layers.configuremaas INFO Controller infra1: Commissioning status is Passed

maas 3.2.11-12069-g.5996fed96 35544 3.2/edge canonical** -

I'll keep checking mine and link..

[Seyeong Kim (seyeongkim)]

I had a discussion with Marian, and after several more tries, this didn't happend but the others.

https://bugs.launchpad.net/maas/+bug/1781241
https://bugs.launchpad.net/maas/+bug/2007297

for 2007297, Mauricio is working on this. and I'll also check the error log if there is something I can do.

Thanks.