[R2.20 Build 3] TSN HA: TOR Agent crash @ OVSDB::OvsdbClientSsl

[chhandak]

Crash while brining up TSN HA setup with build R2.20.3

(gdb) bt
#0 0x00007f9906b94bb9 in raise () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f9906b97fc8 in abort () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x00007f9906b8da76 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#3 0x00007f9906b8db22 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
#4 0x0000000000908b02 in OVSDB::OvsdbClientSsl::OvsdbClientSsl(Agent*, TorAgentParam*, OvsPeerManager*) ()
#5 0x0000000000906223 in OVSDB::OvsdbClient::Allocate(Agent*, TorAgentParam*, OvsPeerManager*) ()
#6 0x00000000008ff4f8 in TorAgentInit::CreateModules() ()
#7 0x0000000000992d6d in AgentInit::InitBase() ()
#8 0x0000000000da3dbf in TaskTrigger::WorkerTask::Run() ()
#9 0x0000000000d9e890 in TaskImpl::execute() ()
#10 0x00007f9907764b3a in ?? () from /usr/lib/libtbb.so.2
#11 0x00007f9907760816 in ?? () from /usr/lib/libtbb.so.2
#12 0x00007f990775ff4b in ?? () from /usr/lib/libtbb.so.2
#13 0x00007f990775c0ff in ?? () from /usr/lib/libtbb.so.2
#14 0x00007f990775c2f9 in ?? () from /usr/lib/libtbb.so.2
#15 0x00007f9907980182 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#16 0x00007f9906c58fbd in clone () from /lib/x86_64-linux-gnu/libc.so.6

Log
------
contrail-tor-agent: controller/src/vnsw/agent/ovs_tor_agent/ovsdb_client/ovsdb_client_ssl.cc:33: OVSDB::OvsdbClientSsl::OvsdbClientSsl(Agent*, TorAgentParam*, OvsPeerManager*): Assertion `ec.value() == 0' failed.
Config file </etc/contrail/contrail-tor-agent-5.conf> parsing completed.

Setup
----------
env.roledefs = {
    'all': [host1, host2, host3, host4, host5, host6],
    'cfgm': [host1, host2, host3],
    'openstack': [host1, host2, host3],
    'webui': [host2],
    'control': [host1, host3],
    'compute': [host4, host5, host6],
    'tsn': [host4, host5],
    'toragent': [host4, host5],
    'collector': [host1, host3],
    'database': [host1, host2, host3],
    'build': [host_build],
}

env.hostnames = {
    'all': ['nodei6', 'nodei7', 'nodei8', 'nodei9', 'nodei10', 'nodei19']
}

testbed location
--------------------------
/root/contrail-fabric-utils/fabfile/testbeds

[Hari Prasad Killi (haripk)]

The assert is due to missing SSL certificates - provisioning isnt complete.

[Prabhjot Singh Sethi (prabhjot)]

we will change assertion to exit with error and log message

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/9670
Submitter: Prabhjot Singh Sethi (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/9679
Submitter: Prabhjot Singh Sethi (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/9670
Committed: http://github.org/Juniper/contrail-controller/commit/bce5a244627d9b54185297f8cbcb5e7a381ecb27
Submitter: Zuul
Branch: master

commit bce5a244627d9b54185297f8cbcb5e7a381ecb27
Author: Prabhjot Singh Sethi <email address hidden>
Date: Wed Apr 29 15:44:48 2015 +0530

Change Assertion to Exit with error

while initialization of ovsdb ssl protocol if,
we fail to find/open cert files exit with error
instead of assertion

Closes-Bug: 1448872
Change-Id: Idf1a2d7043b9980367c2ab1d610049458169b306

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/9679
Committed: http://github.org/Juniper/contrail-controller/commit/fb7545b34db54d3e697008cd5d593b72965788a7
Submitter: Zuul
Branch: R2.20

commit fb7545b34db54d3e697008cd5d593b72965788a7
Author: Prabhjot Singh Sethi <email address hidden>
Date: Wed Apr 29 15:44:48 2015 +0530

Change Assertion to Exit with error

while initialization of ovsdb ssl protocol if,
we fail to find/open cert files exit with error
instead of assertion

Closes-Bug: 1448872
(cherry picked from commit bce5a244627d9b54185297f8cbcb5e7a381ecb27)

Change-Id: I37bb8787a0da1686321a1ce4f9f7e2c712403e2e