addon-resizer was incorrectly using x86 image and cause heapster and sever-metric pods failed

[Zhanglei Mao]

After deploy the charmed kubernetes v1.15 bundle from (https://api.jujucharms.com/charmstore/v5/charmed-kubernetes-209/archive/bundle.yaml)
which us this "charm: cs:~containers/kubernetes-master-700"

The pods status of "metric-server" and "heapster" would show below "CrashLoopBackoff" and "exec format error" of log. This was caused by use x86 docker image.

ubuntu@maas3:~$ kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
...
kube-system heapster-v1.6.0-beta.1-55767866fd-bch2n 2/4 CrashLoopBackOff 54 3h15m
kube-system heapster-v1.6.0-beta.1-5f4f56664b-rqqn8 2/4 CrashLoopBackOff 42 172m
kube-system kubernetes-dashboard-689cfcdbc-v65gq 1/1 Running 0 3h16m
kube-system metrics-server-v0.3.2-7756cff596-78rr4 1/2 CrashLoopBackOff 15 3h16m
...
ubuntu@maas3:~$

1 ubuntu@maas3:~$ kubectl logs pods/heapster-v1.6.0-beta.1-5f4f56664b-rqqn8 -n kube-system -c eventer-nanny
standard_init_linux.go:211: exec user process caused "exec format error"

ubuntu@maas3:~$ kubectl logs pods/heapster-v1.6.0-beta.1-5f4f56664b-rqqn8 -n kube-system -c heapster-nanny
standard_init_linux.go:211: exec user process caused "exec format error"

[Zhanglei Mao (zhanglei-mao)]

The canonical private register didn't provide arm64 image yet. But upstream seems have arm64 of v2.1 docker image which is newer than existing v1.5.

https://github.com/kubernetes/autoscaler/tree/master/addon-resizer
...
Currently recommended version is 1.8, on addon-resizer-release-1.8 branch. The latest version and Docker images are 2.1 pushed to:

gcr.io/google-containers/addon-resizer-amd64:2.1
gcr.io/google-containers/addon-resizer-arm64:2.1
gcr.io/google-containers/addon-resizer-arm:2.1
...

[George Kraft (cynerva)]

PR: https://github.com/charmed-kubernetes/cdk-addons/pull/145

[George Kraft (cynerva)]

Script for building images: https://github.com/charmed-kubernetes/jenkins/pull/507