discovery client doesn't handle some connectivity exceptions

[Deepinder Setia]

Chhandak reported this:

---------------------------------

Hi Nipa,

In a 3 control node cluster for 2 of the control node IFMAP server list is empty. In turn control node does not have any connection with IFMAP server.
System has reach this state after restarting control node multiple time overnight using script with TOR Scale config.

Can you please have a look ?

Control Node1 : http://10.204.217.118:8083/Snh_IFMapPeerServerInfoReq
Control Node3:http://10.204.217.120:8083/Snh_IFMapPeerServerInfoReq

I don’t see IFMAP in service type for any of the discovery node

Node1: http://10.204.217.120:5998/clients
Node2: http://10.204.217.119:5998/clients
Node3: http://10.204.217.120:5998/clients

------------------------------------

Looking at the system it appears that API server and IFMAP services are not getting published even though API server is up and running fine. These two services are published from within API server.

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/16689
Submitter: Deepinder Setia (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/16689
Committed: http://github.org/Juniper/contrail-controller/commit/81c0909313bb6fab6ebca5ba88553272e626c513
Submitter: Zuul
Branch: master

commit 81c0909313bb6fab6ebca5ba88553272e626c513
Author: Deepinder Setia <email address hidden>
Date: Thu Jan 14 14:00:12 2016 -0800

Handle all exceptions while publishing in discovery client
Add stats to discovery client and make them avaiable via
API server introspect.

Change-Id: I2941b9bf4d8bdf89286eb166091a04058edcf884
Partial-Bug: #1534342

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/18403
Submitter: Deepinder Setia (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/18454
Submitter: Deepinder Setia (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/18403
Committed: http://github.org/Juniper/contrail-controller/commit/c3c41048078694f3b302ea5119d29c3a59499cb7
Submitter: Zuul
Branch: master

commit c3c41048078694f3b302ea5119d29c3a59499cb7
Author: Deepinder Setia <email address hidden>
Date: Mon Mar 14 10:57:40 2016 -0700

Catch all exceptions while subscribing also. Otherwise an unknown
exception can cause greenlet to exit and precluding re-subscribe
messages

Change-Id: Ib6211d114e8c640b7a0dd9744f0f44c7fbfc6730
Fixes-bug: #1534342

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/18783
Submitter: Deepinder Setia (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/18784
Submitter: Deepinder Setia (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/18454
Committed: http://github.org/Juniper/contrail-controller/commit/310494b2610df7c85fdcab682b1a1bf494b71c64
Submitter: Zuul
Branch: R2.21.x

commit 310494b2610df7c85fdcab682b1a1bf494b71c64
Author: Deepinder Setia <email address hidden>
Date: Tue Mar 15 14:35:02 2016 -0700

Catch all exceptions in discovery client while publishing or
subscribing

Change-Id: I716c4b2bdeaf27280b14ed88d952dd8e69a4476c
Fixes-bug: #1534342

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/18784
Committed: http://github.org/Juniper/contrail-controller/commit/469475a263ba534eef65b9fabce991e770e6343d
Submitter: Zuul
Branch: R3.0

commit 469475a263ba534eef65b9fabce991e770e6343d
Author: Deepinder Setia <email address hidden>
Date: Mon Mar 14 10:57:40 2016 -0700

Catch all exceptions while subscribing also. Otherwise an unknown
exception can cause greenlet to exit and precluding re-subscribe
messages

Change-Id: Ib6211d114e8c640b7a0dd9744f0f44c7fbfc6730
Fixes-bug: #1534342

Contrail provisioning already sets dns-server policy to fixed. With
this change, we make the same change available to all who may not be
using Contrail provisioning

Change-Id: I00d2de2a8e211508024be64de6d442700a22f002
Fixes-Bug: #1552429