adding vrouter object later does not update VM object created by kube-manager

Bug #1711066 reported by Vedamurthy Joshi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Fix Committed
High
Vedamurthy Joshi
Trunk
Fix Committed
High
Vedamurthy Joshi

Bug Description

R4.0.1.0 Continuous build 22 Ubuntu 16.04.2 container setup

It was noticed that kube-dns pods were not getting launched.
It was seen that the compute node where this pod was scheduled, had not gone through the ansible internal provisioning fully. So the virtual-router object was also not present in contrail controller.
But the kube-dns vm object was created though.
Now, i brought up the agent container successfully later and the virtual-router object was added fine.
But the existing kube-dns VM did not get updated to include a reference to that virtual-router

---
Workaround currently is to restart the kube-dns pod which is stuck in ContainerCreating state

root@testbed-1-vm1:~# kubectl get pods --namespace kube-system -o wide
NAME READY STATUS RESTARTS AGE IP NODE
etcd-testbed-1-vm1 1/1 Running 1 9h 10.204.217.194 testbed-1-vm1
kube-apiserver-testbed-1-vm1 1/1 Running 1 9h 10.204.217.194 testbed-1-vm1
kube-controller-manager-testbed-1-vm1 1/1 Running 3 9h 10.204.217.194 testbed-1-vm1
kube-dns-1327093014-m8mjq 0/3 ContainerCreating 0 9h <none> testbed-1-vm3
kube-dns-2425271678-hq67k 3/3 Running 6 9h 172.17.0.2 testbed-1-vm1
kube-proxy-1hl4n 1/1 Running 1 9h 10.204.217.198 testbed-1-vm3
kube-proxy-9w1jm 1/1 Running 1 9h 10.204.217.197 testbed-1-vm2
kube-proxy-q4h87 1/1 Running 1 9h 10.204.217.194 testbed-1-vm1
kube-scheduler-testbed-1-vm1 1/1 Running 3 9h 10.204.217.194 testbed-1-vm1
root@testbed-1-vm1:~#

Revision history for this message
Vedamurthy Joshi (vedujoshi) wrote : Re: sometimes, vm object for pod is not having link to virtual-router

I applied workaround for https://bugs.launchpad.net/juniperopenstack/+bug/1711274 , and now, am seeing that when a pod got created during that failover time…its vm object did not have link to the vrouter

root@nodec1:~# kubectl get pods -o wide
NAME READY STATUS RESTARTS AGE IP NODE
busybox 0/1 ContainerCreating 0 2m <none> nodek2
nginx1 1/1 Running 0 2m 10.47.255.252 nodek3
root@nodec1:~#

summary: - adding vrouter object later does not update VM object created by kube-
- manager
+ sometimes, vm object for pod is not having link to virtual-router
summary: - sometimes, vm object for pod is not having link to virtual-router
+ adding vrouter object later does not update VM object created by kube-
+ manager
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/34907
Submitter: Yuvaraja Mariappan

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/34921
Submitter: Yuvaraja Mariappan

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/34907
Committed: http://github.com/Juniper/contrail-controller/commit/5b1a20b7343401dff90246dba9955c89ff5112b1
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 5b1a20b7343401dff90246dba9955c89ff5112b1
Author: Yuvaraja Mariappan <email address hidden>
Date: Thu Aug 24 19:43:05 2017 -0700

Fixed pod update issue in k8s

pod->vrouter link would be monitored in vnc_pod timer
call. If the link is not there, link would be created

Change-Id: I43a432e30d95919d92b72b1a780b31375dd9e068
Closes-bug: #1711066

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/34921
Committed: http://github.com/Juniper/contrail-controller/commit/683cc0765f9836f4f4839713c62947dc9f25327d
Submitter: Zuul (<email address hidden>)
Branch: master

commit 683cc0765f9836f4f4839713c62947dc9f25327d
Author: Yuvaraja Mariappan <email address hidden>
Date: Thu Aug 24 19:43:05 2017 -0700

Fixed pod update issue in k8s

pod->vrouter link would be monitored in vnc_pod timer
call. If the link is not there, link would be created

Change-Id: I43a432e30d95919d92b72b1a780b31375dd9e068
Closes-bug: #1711066

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.