R4.1-38-ocata: contrail-vrouter-nodemgr stuck in initializing

[shajuvk]

collector services are up and running in all the nodes even though contrail-node-manager not active.

root@server10:~# contrail-status
== Contrail vRouter ==
contrail-vrouter-agent: active
contrail-vrouter-nodemgr: initializing (Collector connection down)
root@server10:~#

tatus = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector connection down >>, ] >>
11/14/2017 01:13:48 AM [contrail-vrouter-nodemgr]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = server10:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 100449 pid = 1672 http_port = 8102 start_time = 1510218743838720 collector_name = collector_ip = 10.10.0.7:8086 collector_list = [ 10.10.0.9:8086, 10.10.0.7:8086, 10.10.0.8:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >>
11/14/2017 01:13:52 AM [contrail-vrouter-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = server10 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 10.10.0.8:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector connection down >>, ] >>
11/14/2017 01:13:52 AM [contrail-vrouter-nodemgr]: Session Event: TCP Connection Closed
11/14/2017 01:13:52 AM [contrail-vrouter-nodemgr]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = server10 process_status = [ << module_id = contrail-vrouter-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = server_addrs = [ 10.10.0.8:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector connection down >>, ] >>
11/14/2017 01:13:52 AM [contrail-vrouter-nodemgr]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = server10:Compute:contrail-vrouter-nodemgr:0 client_info = << status = Idle successful_connections = 100450 pid = 1672 http_port = 8102 start_time = 1510218743838720 collector_name = collector_ip = 10.10.0.8:8086 collector_list = [ 10.10.0.9:8086, 10.10.0.7:8086, 10.10.0.8:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >>
^C
root@server10:~#

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/37820
Submitter: Sundaresan Rajangam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/37820
Committed: http://github.com/Juniper/contrail-controller/commit/316eb62dd68795e45c54bdd0531c11f2b9886451
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 316eb62dd68795e45c54bdd0531c11f2b9886451
Author: Sundaresan Rajangam <email address hidden>
Date: Wed Nov 22 18:27:09 2017 -0800

Provision contrail-vrouter-nodemgr with sandesh ssl options

sandesh_ssl_enable and introspect_ssl_enable options are not provisioned
in contrail-vrouter-agent. Therefore, if ssl is enabled for the sandesh
connection at the collector, contrail-vrouter-nodemgr is not able to
connect to the collector.

Change-Id: Ia84e121396198e46ae125ebbd05f453382beec1f
Closes-Bug: #1732052

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/37903
Submitter: Sundaresan Rajangam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/37904
Submitter: Sundaresan Rajangam (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/37903
Committed: http://github.com/Juniper/contrail-controller/commit/0180b42735bab74ee67500c554796cea413871e4
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 0180b42735bab74ee67500c554796cea413871e4
Author: Sundaresan Rajangam <email address hidden>
Date: Wed Nov 22 18:27:09 2017 -0800

Provision contrail-vrouter-nodemgr with sandesh ssl options

sandesh_ssl_enable and introspect_ssl_enable options are not provisioned
in contrail-vrouter-agent. Therefore, if ssl is enabled for the sandesh
connection at the collector, contrail-vrouter-nodemgr is not able to
connect to the collector.

Change-Id: Ia84e121396198e46ae125ebbd05f453382beec1f
Closes-Bug: #1732052
(cherry picked from commit 316eb62dd68795e45c54bdd0531c11f2b9886451)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/37904
Committed: http://github.com/Juniper/contrail-controller/commit/6917f960584aecd81dcbec4714c0d06c5254cde4
Submitter: Zuul (<email address hidden>)
Branch: master

commit 6917f960584aecd81dcbec4714c0d06c5254cde4
Author: Sundaresan Rajangam <email address hidden>
Date: Wed Nov 22 18:27:09 2017 -0800

Provision contrail-vrouter-nodemgr with sandesh ssl options

sandesh_ssl_enable and introspect_ssl_enable options are not provisioned
in contrail-vrouter-agent. Therefore, if ssl is enabled for the sandesh
connection at the collector, contrail-vrouter-nodemgr is not able to
connect to the collector.

Change-Id: Ia84e121396198e46ae125ebbd05f453382beec1f
Closes-Bug: #1732052
(cherry picked from commit 316eb62dd68795e45c54bdd0531c11f2b9886451)