ansible-deployer:k8s dashboard version need to be reverted back to v1.8.3 or changed to latest v1.10.0

[Venkatesh Velpula]

Kubernetes dashboard version either need to be reverted back to 1.8.3 version or changed to the latest v1.10.0 as there is no dashboard image available for v1.9.2 as kube version we are using is v1.9.2

https://github.com/kubernetes/dashboard/tags

Erlier the dashboard version was hardcoded in contrail anisble deployer which was changes as part of the commit
https://github.com/Juniper/contrail-ansible-deployer/commit/d7b94d456a64ac13e4e1a9f122f0f89917f89960

[root@nodeg12 contrail-test-runs]# kubectl get nodes
NAME STATUS ROLES AGE VERSION
nodec60 Ready <none> 2h v1.9.2
nodec61 Ready <none> 2h v1.9.2
nodeg12 NotReady master 2h v1.9.2

[root@nodeg12 logs]# kubectl get pods -n kube-system -o wide
NAME READY STATUS RESTARTS AGE IP NOD
kubernetes-dashboard-b8c4fffb7-xtbl6 0/1 ImagePullBackOff 0 2h 10.204.217.101 nodec61

[root@nodeg12 logs]# kubectl describe pod kubernetes-dashboard-b8c4fffb7-xtbl6 -n kube-system
Name: kubernetes-dashboard-b8c4fffb7-xtbl6
Namespace: kube-system
Node: nodec61/10.204.217.101
Start Time: Fri, 19 Oct 2018 22:27:49 +0530
Labels: k8s-app=kubernetes-dashboard
                pod-template-hash=647099963
Annotations: <none>
Status: Pending
IP: 10.204.217.101
Controlled By: ReplicaSet/kubernetes-dashboard-b8c4fffb7
Containers:
  kubernetes-dashboard:
    Container ID:
    Image: k8s.gcr.io/kubernetes-dashboard-amd64:v1.9.2
    Image ID:
    Port: 8443/TCP
    Args:
      --auto-generate-certificates
    State: Waiting
      Reason: ImagePullBackOff
    Ready: False
    Restart Count: 0
    Liveness: http-get https://:8443/ delay=30s timeout=30s period=10s #success=1 #failure=3
    Environment: <none>
    Mounts:
      /certs from kubernetes-dashboard-certs (rw)
      /tmp from tmp-volume (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kubernetes-dashboard-token-chhgf (ro)
Conditions:
  Type Status
  Initialized True
  Ready False
  PodScheduled True
Volumes:
  kubernetes-dashboard-certs:
    Type: Secret (a volume populated by a Secret)
    SecretName: kubernetes-dashboard-certs
    Optional: false
  tmp-volume:
    Type: EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:
  kubernetes-dashboard-token-chhgf:
    Type: Secret (a volume populated by a Secret)
    SecretName: kubernetes-dashboard-token-chhgf
    Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node-role.kubernetes.io/master:NoSchedule
                 node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type Reason Age From Message
  ---- ------ ---- ---- -------
  Normal Pulling 22m (x32 over 2h) kubelet, nodec61 pulling image "k8s.gcr.io/kubernetes-dashboard-amd64:v1.9.2"
  Normal BackOff 7m (x661 over 2h) kubelet, nodec61 Back-off pulling image "k8s.gcr.io/kubernetes-dashboard-amd64:v1.9.2"
  Warning Failed 2m (x682 over 2h) kubelet, nodec61 Error: ImagePullBackOff

[Venkatesh Velpula (vvelpula)]

workaround is to edit the deployment spec of the dashboard and change the version to v1.8.3 or v1.10.0

root@nodeg12 contrail-test-runs]# kubectl get pods --all-namespaces | grep dashboard
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system kubernetes-dashboard-5b94954fbf-24sl7 1/1 ErrImagePull 0 23s

[root@nodeg12 contrail-test-runs]# kubectl edit pod/kubernetes-dashboard-5b94954fbf-24sl7 -n kube-system

spec:
  containers:
  - args:
    - --auto-generate-certificates
    image: k8s.gcr.io/kubernetes-dashboard-amd64:v1.9.2
    change to
    image: k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.0

kubectl delete pod kubernetes-dashboard-5b94954fbf-24sl7 ...this will create new dashboard pod with the changed version

[root@nodeg12 contrail-test-runs]# kubectl delete pod kubernetes-dashboard-5b94954fbf-24sl7 -n kube-system
pod "kubernetes-dashboard-5b94954fbf-24sl7" deleted
[root@nodeg12 contrail-test-runs]# kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system kubernetes-dashboard-5b94954fbf-mprxr 0/1 ContainerCreating 0 2s
kube-system kubernetes-dashboard-5b94954fbf-24sl7 0/1 Terminating 2 42m

[root@nodeg12 contrail-test-runs]# kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system kubernetes-dashboard-5b94954fbf-mprxr 1/1 Running 0 23s

[Sachchidanand Vaidya (vaidyasd)]

Venky
    Has anything changed recently ?
Also it’s marked critical.

Sachin

> On Oct 19, 2018, at 9:20 PM, Venkatesh Velpula <email address hidden> wrote:
>
> ** Also affects: juniperopenstack/r5.0
> Importance: Undecided
> Status: New
>
> ** Changed in: juniperopenstack/r5.0
> Importance: Undecided => Critical
>
> ** Changed in: juniperopenstack/r5.0
> Assignee: (unassigned) => Sachchidanand Vaidya (vaidyasd)
>
> ** Changed in: juniperopenstack/r5.0
> Milestone: None => r5.0.2
>
> ** Changed in: juniperopenstack/trunk
> Milestone: r5.0.2 => r5.1.1
>
> ** Changed in: juniperopenstack/trunk
> Milestone: r5.1.1 => r5.1.0
>
> --
> You received this bug notification because you are a member of Contrail
> Systems engineering, which is subscribed to Juniper Openstack.
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_bugs_1798923&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=I5HZX26fFG_BcSD-_jsadxQTWZc8ZBMrQFM-YZMcm2U&m=fu7v36uGc2wWqsb2KG_hap5lObHla-tiiqWhoGjQq18&s=HG3vv3-eZGcamxOGzH-oYTvK_zFACFjsGen46BKa7e4&e=
>
> Title:
> ansible-deployer:k8s dashboard version need to be reverted back to
> v1.8.3 or changed to latest v1.10.0
>
> Status in Juniper Openstack:
> New
> Status in Juniper Openstack r5.0 series:
> New
> Status in Juniper Openstack trunk series:
> New
>
> Bug description:
>
> Kubernetes dashboard version either need to be reverted back to 1.8.3 version or changed to the latest v1.10.0 as there is no dashboard image available for v1.9.2 as kube version we are using is v1.9.2
>
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_kubernetes_dashboard_tags&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=I5HZX26fFG_BcSD-_jsadxQTWZc8ZBMrQFM-YZMcm2U&m=fu7v36uGc2wWqsb2KG_hap5lObHla-tiiqWhoGjQq18&s=KRnZdI6sARKOR5tMK5wQRzR1eL74yZN-q6bkIlCTz8k&e=
>
>
> Erlier the dashboard version was hardcoded in contrail anisble deployer which was changes as part of the commit
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Juniper_contrail-2Dansible-2Ddeployer_commit_d7b94d456a64ac13e4e1a9f122f0f89917f89960&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=I5HZX26fFG_BcSD-_jsadxQTWZc8ZBMrQFM-YZMcm2U&m=fu7v36uGc2wWqsb2KG_hap5lObHla-tiiqWhoGjQq18&s=vNMsLQVlc28rllNOUChwHbQ1ol09rA7rOiMreT850ew&e=
>
>
> [root@nodeg12 contrail-test-runs]# kubectl get nodes
> NAME STATUS ROLES AGE VERSION
> nodec60 Ready <none> 2h v1.9.2
> nodec61 Ready <none> 2h v1.9.2
> nodeg12 NotReady master 2h v1.9.2
>
>
> [root@nodeg12 logs]# kubectl get pods -n kube-system -o wide
> NAME READY STATUS RESTARTS AGE IP NOD
> kubernetes-dashboard-b8c4fffb7-xtbl6 0/1 ImagePullBackOff 0 2h 10.204.217.101 nodec61
>
>
> [root@nodeg12 logs]# kubectl describe pod kubernetes-dashboard-b8c4fffb7-xtbl6 -n kube-system
> Name: kubernetes-dashboard-b8c4fffb7-xtbl6
> Namespace: kube-system
> Node: no...

[Venkatesh Velpula (vvelpula)]

Hi Sachin ,
    Its due to the change https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Juniper_contrail-2Dansible-2Ddeployer_commit_d7b94d456a64ac13e4e1a9f122f0f89917f89960&d=DwIGaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=BAWbyZyU6JEJeJG5VP03XCRAx8i1J3YysUeNQb7PmmQ&m=ktavm4E4nqZvNNiQwp-OKyAv13P8aQvZ_dKaRzZyV6o&s=Gqni3SruWXwccyaOPmLbDmYOAR3IhgqHnYWgom86Uvo&e= ..
    We gave a workaround for this which I have mentioned in the bug #1 ...change is also very minor ! . I have changed to the criticality for 5.0.2

Thanks
-Venky

[Dinesh Bakiaraj (dineshb)]

Sachin,

Venky pointed to this commit that changed dashboard version and broke it:

https://github.com/Juniper/contrail-ansible-deployer/commit/d7b94d456a64ac13e4e1a9f122f0f89917f89960
This needs to be reverted.

I am not able to lookup this developer.

________________________________
From: Sachchidanand Vaidya
Sent: Friday, October 19, 2018 10:25:57 PM
To: Bug 1798923; Dinesh Bakiaraj; Pragash Vijayaragavan; Prasanna Mucharikar
Subject: Re: [Bug 1798923] Re: ansible-deployer:k8s dashboard version need to be reverted back to v1.8.3 or changed to latest v1.10.0

Venky
    Has anything changed recently ?
Also it’s marked critical.

Sachin

> On Oct 19, 2018, at 9:20 PM, Venkatesh Velpula <email address hidden> wrote:
>
> ** Also affects: juniperopenstack/r5.0
> Importance: Undecided
> Status: New
>
> ** Changed in: juniperopenstack/r5.0
> Importance: Undecided => Critical
>
> ** Changed in: juniperopenstack/r5.0
> Assignee: (unassigned) => Sachchidanand Vaidya (vaidyasd)
>
> ** Changed in: juniperopenstack/r5.0
> Milestone: None => r5.0.2
>
> ** Changed in: juniperopenstack/trunk
> Milestone: r5.0.2 => r5.1.1
>
> ** Changed in: juniperopenstack/trunk
> Milestone: r5.1.1 => r5.1.0
>
> --
> You received this bug notification because you are a member of Contrail
> Systems engineering, which is subscribed to Juniper Openstack.
> https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_bugs_1798923&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=I5HZX26fFG_BcSD-_jsadxQTWZc8ZBMrQFM-YZMcm2U&m=fu7v36uGc2wWqsb2KG_hap5lObHla-tiiqWhoGjQq18&s=HG3vv3-eZGcamxOGzH-oYTvK_zFACFjsGen46BKa7e4&e=
>
> Title:
> ansible-deployer:k8s dashboard version need to be reverted back to
> v1.8.3 or changed to latest v1.10.0
>
> Status in Juniper Openstack:
> New
> Status in Juniper Openstack r5.0 series:
> New
> Status in Juniper Openstack trunk series:
> New
>
> Bug description:
>
> Kubernetes dashboard version either need to be reverted back to 1.8.3 version or changed to the latest v1.10.0 as there is no dashboard image available for v1.9.2 as kube version we are using is v1.9.2
>
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_kubernetes_dashboard_tags&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=I5HZX26fFG_BcSD-_jsadxQTWZc8ZBMrQFM-YZMcm2U&m=fu7v36uGc2wWqsb2KG_hap5lObHla-tiiqWhoGjQq18&s=KRnZdI6sARKOR5tMK5wQRzR1eL74yZN-q6bkIlCTz8k&e=
>
>
> Erlier the dashboard version was hardcoded in contrail anisble deployer which was changes as part of the commit
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Juniper_contrail-2Dansible-2Ddeployer_commit_d7b94d456a64ac13e4e1a9f122f0f89917f89960&d=DwIFaQ&c=HAkYuh63rsuhr6Scbfh0UjBXeMK-ndb3voDTXcWzoCI&r=I5HZX26fFG_BcSD-_jsadxQTWZc8ZBMrQFM-YZMcm2U&m=fu7v36uGc2wWqsb2KG_hap5lObHla-tiiqWhoGjQq18&s=vNMsLQVlc28rllNOUChwHbQ1ol09rA7rOiMreT850ew&e=
>
>
> [root@nodeg12 contrail-test-runs]# kubectl get nodes
> NAME STATUS ROLES AGE VERSION
> nodec60 Ready <none> 2h v1.9.2
> nodec61 Ready <none> 2h v1.9.2
> nodeg12 NotReady master 2h v1.9.2
>
>
> [root@nodeg12 logs]# k...

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/47177
Submitter: Andrey Pavlov (<email address hidden>)

[Andrey Pavlov (apavlov-e)]

available versions - https://github.com/kubernetes/dashboard/tags

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/47178
Submitter: Andrey Pavlov (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/47178
Committed: http://github.com/Juniper/contrail-ansible-deployer/commit/d3d7a115b1cb32e6b54d70e48428d94864d5d32d
Submitter: Zuul v3 CI (<email address hidden>)
Branch: master

commit d3d7a115b1cb32e6b54d70e48428d94864d5d32d
Author: Andrey Pavlov <email address hidden>
Date: Sat Oct 20 12:41:59 2018 -0700

Revert "Update kubernetes-dashboard version"

dashboard has a limited number of versions and version of k8s can't be used for dashboard as well.
separate variable with version is required for dashboard.

This reverts commit a1677292264360c436cbd2a9d0096f7754451a78.

Closes-Bug: #1798923
Change-Id: I4c46c925fc338cd9bbf43e4fd6d01cd07eb2afb1

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/47177
Committed: http://github.com/Juniper/contrail-ansible-deployer/commit/0dccd6734bb2d287ee86383e34fdaf01a4cf34e5
Submitter: Zuul v3 CI (<email address hidden>)
Branch: R5.0

commit 0dccd6734bb2d287ee86383e34fdaf01a4cf34e5
Author: Andrey Pavlov <email address hidden>
Date: Sat Oct 20 12:41:59 2018 -0700

Revert "Update kubernetes-dashboard version"

dashboard has a limited number of versions and version of k8s can't be used for dashboard as well.
separate variable with version is required for dashboard.

This reverts commit a1677292264360c436cbd2a9d0096f7754451a78.

Closes-Bug: #1798923
Change-Id: I4c46c925fc338cd9bbf43e4fd6d01cd07eb2afb1

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/47181
Submitter: Andrey Pavlov (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/47227
Submitter: Andrey Pavlov (<email address hidden>)

[Venkatesh Velpula (vvelpula)]

[root@nodeg12 ~]# kubectl get pods -n kube-system
NAME READY STATUS RESTARTS AGE
etcd-nodeg12 1/1 Running 0 27m
kube-apiserver-nodeg12 1/1 Running 0 27m
kube-controller-manager-nodeg12 1/1 Running 0 27m
kube-dns-6f4fd4bdf-zf2rt 3/3 Running 0 36m
kube-proxy-h798g 1/1 Running 0 36m
kube-proxy-pcfpk 1/1 Running 0 36m
kube-proxy-sg4nw 1/1 Running 0 36m
kube-scheduler-nodeg12 1/1 Running 0 27m
kubernetes-dashboard-846c4ddc5f-shjzh 1/1 Running 0 36m

[root@nodeg12 ~]# docker ps | grep kube
4f9711f4316d 10.204.217.152:5000/contrail-kubernetes-kube-manager:queens-5.0-307 "/entrypoint.sh /usr…" 32 minutes ago Up 44 seconds kubemanager_kubemanager_1
228e4b3ee5c9 gcr.io/google_containers/kube-proxy-amd64 "/usr/local/bin/kube…" 36 minutes ago Up 36 minutes k8s_kube-proxy_kube-proxy-sg4nw_kube-system_6e9ba4ce-d74e-11e8-9f9a-002590c476a0_0
fe70bc8b279f gcr.io/google_containers/pause-amd64:3.0 "/pause" 36 minutes ago Up 36 minutes k8s_POD_kube-proxy-sg4nw_kube-system_6e9ba4ce-d74e-11e8-9f9a-002590c476a0_0
a05c07188476 gcr.io/google_containers/kube-controller-manager-amd64 "kube-controller-man…" 36 minutes ago Up 36 minutes k8s_kube-controller-manager_kube-controller-manager-nodeg12_kube-system_82b5b3db864566fee600546b7e840047_0
976450ec9fb5 gcr.io/google_containers/kube-apiserver-amd64 "kube-apiserver --in…" 36 minutes ago Up 36 minutes k8s_kube-apiserver_kube-apiserver-nodeg12_kube-system_6ec43fd78d66a7d4eb2f8b66b4a6ab6e_0
fab91bce15ae gcr.io/google_containers/kube-scheduler-amd64 "kube-scheduler --ad…" 36 minutes ago Up 36 minutes k8s_kube-scheduler_kube-scheduler-nodeg12_kube-system_69c12074e336b0dbbd0a1666ce05226a_0
56c8774c8c2f gcr.io/google_containers/etcd-amd64 "etcd --listen-clien…" 36 minutes ago Up 36 minutes k8s_etcd_etcd-nodeg12_kube-system_7278f85057e8bf5cb81c9f96d3b25320_0
952e1c8b1eeb gcr.io/google_containers/pause-amd64:3.0 "/pause" 37 minutes ago Up 37 minutes k8s_POD_kube-scheduler-nodeg12_kube-system_69c12074e336b0dbbd0a1666ce05226a_0
d9d43ff98fb7 gcr.io/google_containers/pause-amd64:3.0 "/pause" 37 minutes ago Up 37 minutes k8s_POD_kube-controller-manager-nodeg12_kube-system_82b5b3db864566fee600546b7e840047_0
28f322352ad8 gcr.io/google_...

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/47227
Committed: http://github.com/Juniper/contrail-ansible-deployer/commit/1dd4f076bf7a5d14a9993f60d46d648d4925b446
Submitter: Zuul v3 CI (<email address hidden>)
Branch: R5.0

commit 1dd4f076bf7a5d14a9993f60d46d648d4925b446
Author: Andrey Pavlov <email address hidden>
Date: Mon Oct 22 12:31:16 2018 +0300

introduce parameter k8s_dashboard_version

k8s_version can't be used for dashboard cause dashboard has own set of versions

Change-Id: I24bdd25c230e4ef9e8325679128df10315b17289
Partial-Bug: #1798923

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/47181
Committed: http://github.com/Juniper/contrail-ansible-deployer/commit/4c88e1b7da0e8e23ec3ec65d6e796716c30c804b
Submitter: Zuul v3 CI (<email address hidden>)
Branch: master

commit 4c88e1b7da0e8e23ec3ec65d6e796716c30c804b
Author: Andrey Pavlov <email address hidden>
Date: Mon Oct 22 12:31:16 2018 +0300

introduce parameter k8s_dashboard_version

k8s_version can't be used for dashboard cause dashboard has own set of versions

Change-Id: I24bdd25c230e4ef9e8325679128df10315b17289
Partial-Bug: #1798923