Brief Description
-----------------
Ansible playbook fails to install due to missing kubernetes helm from the online address. Please see below logs from ansible.
Steps to Reproduce
------------------
Install stx 5.0 ISO and run the ansible playbook
Expected Behavior
------------------
Ansible have all pass
System Configuration
--------------------
stx 5.0, SImplex
Timestamp/Logs
--------------
TASK [common/push-docker-images : Download images and push to local registry] **************************************************************************************
fatal: [localhost]: FAILED! => {"changed": true, "msg": "non-zero return code", "rc": 1, "stderr": "Traceback (most recent call last):\n File \"/tmp/.ansible-sysadmin/tmp/ansible-tmp-1631650619.5-245727825340456/download_images.py\", line 144, in <module>\n raise Exception(\"Failed to download images %s\" % failed_downloads)\nException: Failed to download images ['gcr.io/kubernetes-helm/tiller:v2.16.1']\n", "stderr_lines": ["Traceback (most recent call last):", " File \"/tmp/.ansible-sysadmin/tmp/ansible-tmp-1631650619.5-245727825340456/download_images.py\", line 144, in <module>", " raise Exception(\"Failed to download images %s\" % failed_downloads)", "Exception: Failed to download images ['gcr.io/kubernetes-helm/tiller:v2.16.1']"], "stdout": "Image is up to date for sha256:a595af0107f98768274e9143be61c7c80a8df2505ced520c9160f4e16ed42cd1\nImage is up to date for sha256:d1ccdd18e6ed8d91e3754e90c4b6cee42750ba165c75d3c78b4a31f057dd0423\nImage is up to date for sha256:6c9320041a7b5d00da54dda3a6bf9d6983b432ca5245a8254c83fc694d023810\nImage is up to date for sha256:4e68534e24f67f912c02ef114131e0ffcd060af0365988800ce0e24af323b165\nImage is up to date for sha256:80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c\nImage is up to date for sha256:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f\nImage is up to date for sha256:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5\nImage is up to date for sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8\nImage is up to date for sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5\nImage is up to date for sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8\nImage is up to date for sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d\nImage is up to date for sha256:7cf8e2d1b7337338a3f977d07abdf63d80d5005458dfab3ab8962c2bab99d40d\nImage is up to date for sha256:f2a1744e620d3bf673f8351dcfaa5334fe4888cfcd5476b0222499ccc1b158fe\nImage is up to date for sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea\nImage download succeeded: k8s.gcr.io/kube-apiserver:v1.18.1\nImage push succeeded: registry.local:9001/k8s.gcr.io/kube-apiserver:v1.18.1\nImage k8s.gcr.io/kube-apiserver:v1.18.1 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/kube-controller-manager:v1.18.1\nImage push succeeded: registry.local:9001/k8s.gcr.io/kube-controller-manager:v1.18.1\nImage k8s.gcr.io/kube-controller-manager:v1.18.1 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/kube-scheduler:v1.18.1\nImage push succeeded: registry.local:9001/k8s.gcr.io/kube-scheduler:v1.18.1\nImage k8s.gcr.io/kube-scheduler:v1.18.1 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/kube-proxy:v1.18.1\nImage push succeeded: registry.local:9001/k8s.gcr.io/kube-proxy:v1.18.1\nImage k8s.gcr.io/kube-proxy:v1.18.1 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/pause:3.2\nImage push succeeded: registry.local:9001/k8s.gcr.io/pause:3.2\nImage k8s.gcr.io/pause:3.2 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/etcd:3.4.3-0\nImage push succeeded: registry.local:9001/k8s.gcr.io/etcd:3.4.3-0\nImage k8s.gcr.io/etcd:3.4.3-0 download succeeded by containerd\nImage download succeeded: k8s.gcr.io/coredns:1.6.7\nImage push succeeded: registry.local:9001/k8s.gcr.io/coredns:1.6.7\nImage k8s.gcr.io/coredns:1.6.7 download succeeded by containerd\nImage download succeeded: quay.io/calico/cni:v3.12.0\nImage push succeeded: registry.local:9001/quay.io/calico/cni:v3.12.0\nImage quay.io/calico/cni:v3.12.0 download succeeded by containerd\nImage download succeeded: quay.io/calico/node:v3.12.0\nImage push succeeded: registry.local:9001/quay.io/calico/node:v3.12.0\nImage quay.io/calico/node:v3.12.0 download succeeded by containerd\nImage download succeeded: quay.io/calico/kube-controllers:v3.12.0\nImage push succeeded: registry.local:9001/quay.io/calico/kube-controllers:v3.12.0\nImage quay.io/calico/kube-controllers:v3.12.0 download succeeded by containerd\nImage download succeeded: quay.io/calico/pod2daemon-flexvol:v3.12.0\nImage push succeeded: registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0\nImage quay.io/calico/pod2daemon-flexvol:v3.12.0 download succeeded by containerd\nImage download succeeded: docker.io/nfvpe/multus:v3.4\nImage push succeeded: registry.local:9001/docker.io/nfvpe/multus:v3.4\nImage docker.io/nfvpe/multus:v3.4 download succeeded by containerd\nImage download succeeded: docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8\nImage push succeeded: registry.local:9001/docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8\nImage docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8 download succeeded by containerd\nImage download succeeded: docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae\nImage push succeeded: registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae\nImage docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae download succeeded by containerd\n Image download failed: gcr.io/kubernetes-helm/tiller:v2.16.1500 Server Error: Internal Server Error (\"Get https://gcr.io/v2/kubernetes-helm/tiller/manifests/v2.16.1: denied: Project kubernetes-helm has been deleted.\")\nSleep 20s before retry downloading image gcr.io/kubernetes-helm/tiller:v2.16.1 ...\n Image download failed: gcr.io/kubernetes-helm/tiller:v2.16.1500 Server Error: Internal Server Error (\"Get https://gcr.io/v2/kubernetes-helm/tiller/manifests/v2.16.1: denied: Project kubernetes-helm has been deleted.\")\nSleep 20s before retry downloading image gcr.io/kubernetes-helm/tiller:v2.16.1 ...\n Image download failed: gcr.io/kubernetes-helm/tiller:v2.16.1500 Server Error: Internal Server Error (\"Get https://gcr.io/v2/kubernetes-helm/tiller/manifests/v2.16.1: denied: Project kubernetes-helm has been deleted.\")\nSleep 20s before retry downloading image gcr.io/kubernetes-helm/tiller:v2.16.1 ...\nImage download succeeded: quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\nImage push succeeded: registry.local:9001/quImage is up to date for sha256:3061a8a540ac0dee710c1b37edad7855581dc027a18890759c91792615505f13\nImage is up to date for sha256:fb95693fe5c67fc46893c1735d85f00f462dc7f5254f5ddbcbbe85fd4ef71717\nImage is up to date for sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89\nImage is up to date for sha256:d4553944fbf7b50f20eece0ec3f638202fdbe2a1a597af8c3f3823201cc695b3\nay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic\nImage quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic download succeeded by containerd\nImage download succeeded: docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0\nImage push succeeded: registry.local:9001/docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0\nImage docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0 download succeeded by containerd\nImage download succeeded: quay.io/stackanetes/kubernetes-entrypoint:v0.3.1\nImage push succeeded: registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1\nImage quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by containerd\nImage download succeeded: quay.io/k8scsi/snapshot-controller:v2.0.0-rc2\nImage push succeeded: registry.local:9001/quay.io/k8scsi/snapshot-controller:v2.0.0-rc2\nImage quay.io/k8scsi/snapshot-controller:v2.0.0-rc2 download succeeded by containerd\n", "stdout_lines": ["Image is up to date for sha256:a595af0107f98768274e9143be61c7c80a8df2505ced520c9160f4e16ed42cd1", "Image is up to date for sha256:d1ccdd18e6ed8d91e3754e90c4b6cee42750ba165c75d3c78b4a31f057dd0423", "Image is up to date for sha256:6c9320041a7b5d00da54dda3a6bf9d6983b432ca5245a8254c83fc694d023810", "Image is up to date for sha256:4e68534e24f67f912c02ef114131e0ffcd060af0365988800ce0e24af323b165", "Image is up to date for sha256:80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c", "Image is up to date for sha256:303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f", "Image is up to date for sha256:67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5", "Image is up to date for sha256:cb6799752c46cb16c0c5bebcb355e988a1cd1b3745ce8b67e004abe9a81340a8", "Image is up to date for sha256:fc05bc4225f39e81dcbd0035457977276ed8a6054e6bde6406e39b672e9724f5", "Image is up to date for sha256:53aa421faf0acd88f8a4cb113e9db2cc65b2a2954640ed96a56c4b94233674d8", "Image is up to date for sha256:98793d0a88c823c4fc0fb1b3833d12932be270fc4b6d62bc181f0f54413fe12d", "Image is up to date for sha256:7cf8e2d1b7337338a3f977d07abdf63d80d5005458dfab3ab8962c2bab99d40d", "Image is up to date for sha256:f2a1744e620d3bf673f8351dcfaa5334fe4888cfcd5476b0222499ccc1b158fe", "Image is up to date for sha256:a2bef2b25274b1acbdfde5e2f3de432475e15d4036b2108cea2dce968b0c29ea", "Image download succeeded: k8s.gcr.io/kube-apiserver:v1.18.1", "Image push succeeded: registry.local:9001/k8s.gcr.io/kube-apiserver:v1.18.1", "Image k8s.gcr.io/kube-apiserver:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/kube-controller-manager:v1.18.1", "Image push succeeded: registry.local:9001/k8s.gcr.io/kube-controller-manager:v1.18.1", "Image k8s.gcr.io/kube-controller-manager:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/kube-scheduler:v1.18.1", "Image push succeeded: registry.local:9001/k8s.gcr.io/kube-scheduler:v1.18.1", "Image k8s.gcr.io/kube-scheduler:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/kube-proxy:v1.18.1", "Image push succeeded: registry.local:9001/k8s.gcr.io/kube-proxy:v1.18.1", "Image k8s.gcr.io/kube-proxy:v1.18.1 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/pause:3.2", "Image push succeeded: registry.local:9001/k8s.gcr.io/pause:3.2", "Image k8s.gcr.io/pause:3.2 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/etcd:3.4.3-0", "Image push succeeded: registry.local:9001/k8s.gcr.io/etcd:3.4.3-0", "Image k8s.gcr.io/etcd:3.4.3-0 download succeeded by containerd", "Image download succeeded: k8s.gcr.io/coredns:1.6.7", "Image push succeeded: registry.local:9001/k8s.gcr.io/coredns:1.6.7", "Image k8s.gcr.io/coredns:1.6.7 download succeeded by containerd", "Image download succeeded: quay.io/calico/cni:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/cni:v3.12.0", "Image quay.io/calico/cni:v3.12.0 download succeeded by containerd", "Image download succeeded: quay.io/calico/node:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/node:v3.12.0", "Image quay.io/calico/node:v3.12.0 download succeeded by containerd", "Image download succeeded: quay.io/calico/kube-controllers:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/kube-controllers:v3.12.0", "Image quay.io/calico/kube-controllers:v3.12.0 download succeeded by containerd", "Image download succeeded: quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image push succeeded: registry.local:9001/quay.io/calico/pod2daemon-flexvol:v3.12.0", "Image quay.io/calico/pod2daemon-flexvol:v3.12.0 download succeeded by containerd", "Image download succeeded: docker.io/nfvpe/multus:v3.4", "Image push succeeded: registry.local:9001/docker.io/nfvpe/multus:v3.4", "Image docker.io/nfvpe/multus:v3.4 download succeeded by containerd", "Image download succeeded: docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8", "Image push succeeded: registry.local:9001/docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8", "Image docker.io/starlingx/k8s-cni-sriov:stx.5.0-v2.6-7-gb18123d8 download succeeded by containerd", "Image download succeeded: docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae", "Image push succeeded: registry.local:9001/docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae", "Image docker.io/starlingx/k8s-plugins-sriov-network-device:stx.4.0-v3.2-16-g4e0302ae download succeeded by containerd", " Image download failed: gcr.io/kubernetes-helm/tiller:v2.16.1500 Server Error: Internal Server Error (\"Get https://gcr.io/v2/kubernetes-helm/tiller/manifests/v2.16.1: denied: Project kubernetes-helm has been deleted.\")", "Sleep 20s before retry downloading image gcr.io/kubernetes-helm/tiller:v2.16.1 ...", " Image download failed: gcr.io/kubernetes-helm/tiller:v2.16.1500 Server Error: Internal Server Error (\"Get https://gcr.io/v2/kubernetes-helm/tiller/manifests/v2.16.1: denied: Project kubernetes-helm has been deleted.\")", "Sleep 20s before retry downloading image gcr.io/kubernetes-helm/tiller:v2.16.1 ...", " Image download failed: gcr.io/kubernetes-helm/tiller:v2.16.1500 Server Error: Internal Server Error (\"Get https://gcr.io/v2/kubernetes-helm/tiller/manifests/v2.16.1: denied: Project kubernetes-helm has been deleted.\")", "Sleep 20s before retry downloading image gcr.io/kubernetes-helm/tiller:v2.16.1 ...", "Image download succeeded: quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "Image push succeeded: registry.local:9001/quImage is up to date for sha256:3061a8a540ac0dee710c1b37edad7855581dc027a18890759c91792615505f13", "Image is up to date for sha256:fb95693fe5c67fc46893c1735d85f00f462dc7f5254f5ddbcbbe85fd4ef71717", "Image is up to date for sha256:7fb3c2364b87e9241db7549bf11d42c129130f44e930d1ce36523fc693186e89", "Image is up to date for sha256:d4553944fbf7b50f20eece0ec3f638202fdbe2a1a597af8c3f3823201cc695b3", "ay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic", "Image quay.io/airshipit/armada:8a1638098f88d92bf799ef4934abe569789b885e-ubuntu_bionic download succeeded by containerd", "Image download succeeded: docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image push succeeded: registry.local:9001/docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0", "Image docker.io/starlingx/n3000-opae:stx.4.0-v1.0.0 download succeeded by containerd", "Image download succeeded: quay.io/stackanetes/kubernetes-entrypoint:v0.3.1", "Image push succeeded: registry.local:9001/quay.io/stackanetes/kubernetes-entrypoint:v0.3.1", "Image quay.io/stackanetes/kubernetes-entrypoint:v0.3.1 download succeeded by containerd", "Image download succeeded: quay.io/k8scsi/snapshot-controller:v2.0.0-rc2", "Image push succeeded: registry.local:9001/quay.io/k8scsi/snapshot-controller:v2.0.0-rc2", "Image quay.io/k8scsi/snapshot-controller:v2.0.0-rc2 download succeeded by containerd"]}
PLAY RECAP *********************************************************************************************************************************************************
localhost : ok=200 changed=67 unreachable=0 failed=1
This is a duplicate of https:/