Horizon online check failure

[Marian Gasparovic]

During `enable observability` one of horizon units reported "(container:horizon) healthcheck failed: online"

Logs of the pod show many occurrences of [pebble] Check "online" failure 1 (threshold 3): Get "http://localhost:80//openstack-horizon/auth/login/": context deadline exceeded

Logs and artifacts - https://oil-jenkins.canonical.com/artifacts/ebb3d87b-ccb0-4582-a89a-1a1dc66bc951/index.html

[Guillaume Boutry (gboutry)]

This looks like pebble timed out on getting horizon's auth page to load. Was the system under load ? The current timeout is 12s

[Marian Gasparovic (marosg)]

It was under the usual load like during any cluster resize, we have many resize actions working

[Chris Johnston (cjohnston)]

I am seeing the same thing on a fresh MAAS deploy prior to enabling any plugins or adding any workload.