Comment 0 for bug 1522703

Revision history for this message
Ankit Jain (ankitja) wrote :

Issue : Contrail collector timing out due to discovery not receiving heartbeat properly

== Contrail Analytics ==
supervisor-analytics: active
contrail-alarm-gen active
contrail-analytics-api active
contrail-analytics-nodemgr active
contrail-collector timeout
contrail-query-engine active
contrail-snmp-collector active
contrail-topology active

Home | Publishers | Subscribers | Stats | Config | Cleanup |
Service Type Remote IP Service Id Oper State Admin State In Use Time since last Heartbeat
OpServer 40.43.1.5 nodeg32:OpServer up up 1 0:00:01
OpServer 40.43.1.6 nodeh1:OpServer up up 1 0:00:02
OpServer 40.43.1.7 nodeh2:OpServer up up 1 0:00:01
AlarmGenerator 40.43.1.5 nodeg32:AlarmGenerator up up 0 0:00:05
AlarmGenerator 40.43.1.6 nodeh1:AlarmGenerator up up 0 0:00:03
AlarmGenerator 40.43.1.7 nodeh2:AlarmGenerator up up 0 0:00:03
IfmapServer 40.43.1.5 nodeg32:IfmapServer up up 3 0:00:07
IfmapServer 40.43.1.6 nodeh1:IfmapServer up up 2 0:00:09
IfmapServer 40.43.1.7 nodeh2:IfmapServer up up 3 0:00:03
dns-server 40.43.1.6 nodeh1:dns-server up up 5 0:00:00
dns-server 40.43.1.7 nodeh2:dns-server up up 5 0:00:01
xmpp-server 40.43.1.6 nodeh1:xmpp-server up up 4 0:00:03
xmpp-server 40.43.1.7 nodeh2:xmpp-server up up 4 0:00:01
Collector 40.43.1.5 nodeg32:Collector up up 17 0:00:07
Collector 40.43.1.6 nodeh1:Collector up up 23 0:00:04
Collector 40.43.1.7 nodeh2:Collector up up 30 0:00:04
ApiServer 40.43.1.5 nodeg32:ApiServer up up 1 0:00:07
ApiServer 40.43.1.6 nodeh1:ApiServer up up 1 0:00:04
ApiServer 40.43.1.7 nodeh2:ApiServer up up 1 0:00:03

/var/log/contrail-collector:
2015-12-04 Fri 12:44:27:860.073 IST nodeg32 [Thread 140232816654080, Pid 30179]: nodeg32:Analytics:contrail-analytics-api:0: Db_BatchAddColumn:controller/src/database/cassandra/thrift/thrift_if_impl.cc:1455: 6: TimedOutException: Default TException.
2015-12-04 Fri 12:44:27:860.284 IST nodeg32 [Thread 140232820852480, Pid 30179]: nodeg32:Global: Db_BatchAddColumn:controller/src/database/cassandra/thrift/thrift_if_impl.cc:1455: 7: TimedOutException: Default TException.
2015-12-04 Fri 12:44:28:533.860 IST nodeg32 [Thread 140232787277568, Pid 30179]: nodeg32:Analytics:contrail-collector:0: Db_BatchAddColumn:controller/src/database/cassandra/thrift/thrift_if_impl.cc:1455: 16: TimedOutException: Default TException.
2015-12-04 Fri 12:44:30:657.640 IST nodeg32 [Thread 140232816654080, Pid 30179]: nodeg32:Analytics:contrail-collector:0: Db_BatchAddColumn:controller/src/database/cassandra/thrift/thrift_if_impl.cc:1455: 20: TimedOutException: Default TException.