sm3.0.2723: collector connections are down after target provision gets compeleted

[sundarkh]

sm3.0.2723: collector connections are down after target provision gets compeleted

/var/log/contrail/contrail-collector.log

2016-03-01 Tue 05:15:22:942.604 PST nodeg21 [Thread 140074977943808, Pid 29376]: Kafka new topic -uve-12 Err
2016-03-01 Tue 05:15:22:942.613 PST nodeg21 [Thread 140074977943808, Pid 29376]: Kafka new topic -uve-13 Err
2016-03-01 Tue 05:15:22:942.623 PST nodeg21 [Thread 140074977943808, Pid 29376]: Kafka new topic -uve-14 Err
2016-03-01 Tue 05:15:23:958.214 PST nodeg21 [Thread 140074752755456, Pid 29376]: CassLibrary: src/connection.cpp:791 void cass::Connection::notify_error(const string&, cass::Connection::ConnectionError)] Host 10.204.217.61 received invalid protocol response Invalid or unsupported protocol version: 4
2016-03-01 Tue 05:15:23:958.333 PST nodeg21 [Thread 140074752755456, Pid 29376]: CassLibrary: src/control_connection.cpp:204 virtual void cass::ControlConnection::on_close(cass::Connection*)] Lost control connection on host 10.204.217.61

root@nodeg21:~# /opt/contrail/contrail_server_manager/provision_status.sh
{
    "cluster": [
        {
            "provision_role_sequence": "{'completed': [('nodeg21', 'haproxy', '2016_03_01__04_59_08'), ('nodec58', 'haproxy', '2016_03_01__05_01_43'), ('nodeg21', 'database', '2016_03_01__05_02_15'), ('nodeg33', 'database', '2016_03_01__05_02_18'), ('nodec58', 'database', '2016_03_01__05_04_23'), ('nodeg33', 'openstack', '2016_03_01__05_09_21'), ('nodeg21', 'config', '2016_03_01__05_12_47'), ('nodec58', 'config', '2016_03_01__05_14_28'), ('nodeg33', 'control', '2016_03_01__05_15_08'), ('nodec58', 'control', '2016_03_01__05_15_11'), ('nodeg21', 'collector', '2016_03_01__05_15_34'), ('nodeg21', 'webui', '2016_03_01__05_15_44'), ('nodec58', 'post_provision', '2016_03_01__05_15_53'), ('nodeg21', 'post_provision', '2016_03_01__05_15_53'), ('nodeg33', 'post_provision', '2016_03_01__05_16_04'), ('nodeg17', 'compute', '2016_03_01__05_20_26'), ('nodeg17', 'post_provision', '2016_03_01__05_20_37'), ('nodec38', 'compute', '2016_03_01__05_28_08'), ('nodec38', 'post_provision', '2016_03_01__05_28_22')], 'steps': []}"
        }
    ]
}
{
    "server": [
        {
            "id": "nodeg21",
            "ip_address": "10.204.217.61",
            "mac_address": "00:25:90:C4:76:64",
            "status": "provision_completed"
        },
        {
            "id": "nodec38",
            "ip_address": "10.204.217.23",
            "mac_address": "00:25:90:C4:81:50",
            "status": "provision_completed"
        },
        {
            "id": "nodeg17",
            "ip_address": "10.204.217.57",
            "mac_address": "00:25:90:C4:76:B2",
            "status": "provision_completed"
        },
        {
            "id": "nodec58",
            "ip_address": "10.204.217.98",
            "mac_address": "00:25:90:C5:59:9E",
            "status": "provision_completed"
        },
        {
            "id": "nodeg33",
            "ip_address": "10.204.217.73",
            "mac_address": "00:25:90:C5:61:BE",
            "status": "provision_completed"
        }
    ]
}
root@nodeg21:~# contrail-status
== Contrail Analytics ==
supervisor-analytics: active
contrail-alarm-gen initializing (Collector connection down)
contrail-analytics-api initializing (Collector connection down)
contrail-analytics-nodemgr active
contrail-collector initializing
contrail-query-engine timeout
contrail-snmp-collector initializing (Collector connection down)
contrail-topology initializing (Collector connection down)

== Contrail Config ==
supervisor-config: active
contrail-api:0 initializing (Collector connection down)
contrail-config-nodemgr active
contrail-device-manager backup
contrail-discovery:0 initializing (Collector connection down)
contrail-schema backup
contrail-svc-monitor initializing (Collector connection down)
ifmap active

== Contrail Web UI ==
supervisor-webui: active
contrail-webui active
contrail-webui-middleware active

== Contrail Database ==
contrail-database: active
supervisor-database: active
contrail-database-nodemgr active
kafka active

== Contrail Support Services ==
supervisor-support-service: active
rabbitmq-server active

Sm: nodej8
cfgm0- nodeg21