[Ubuntu 2.20-64] Tor agent crash @ static int SandeshHttp::Init

Bug #1474258 reported by chhandak
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R2.20
Fix Committed
High
Megh Bhatt
Trunk
Fix Committed
High
Megh Bhatt

Bug Description

Backtrace
----------------
(gdb) bt
#0 0x00007fad25505cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007fad255090d8 in __GI_abort () at abort.c:89
#2 0x00007fad254feb86 in __assert_fail_base (fmt=0x7fad2564f830 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=assertion@entry=0xea8861 "hServ_->Initialize(port)",
    file=file@entry=0xea89f0 "tools/sandesh/library/cpp/sandesh_http.cc", line=line@entry=405,
    function=function@entry=0xea91e0 "static int SandeshHttp::Init(EventManager*, std::string, short int, SandeshHttp::RequestCallbackFn)") at assert.c:92
#3 0x00007fad254fec32 in __GI___assert_fail (assertion=0xea8861 "hServ_->Initialize(port)", file=0xea89f0 "tools/sandesh/library/cpp/sandesh_http.cc", line=405,
    function=0xea91e0 "static int SandeshHttp::Init(EventManager*, std::string, short int, SandeshHttp::RequestCallbackFn)") at assert.c:101
#4 0x0000000000d2bbb5 in SandeshHttp::Init(EventManager*, std::string, short, boost::function<int (SandeshRequest*)>) ()
#5 0x0000000000d20eac in Sandesh::Initialize(Sandesh::SandeshRole::type, std::string const&, std::string const&, std::string const&, std::string const&, EventManager*, unsigned short, SandeshContext*) ()
#6 0x0000000000d220eb in Sandesh::InitGenerator(std::string const&, std::string const&, std::string const&, std::string const&, EventManager*, unsigned short, boost::function<void (std::string, unsigned char, boost::function<void (std::vector<DSResponse, std::allocator<DSResponse> >)>)>, std::vector<std::string, std::allocator<std::string> > const&, SandeshContext*) ()
#7 0x0000000000a2f8f8 in DiscoveryAgentClient::DiscoverServices() ()
#8 0x00000000009c34d2 in AgentInit::InitDoneBase() ()
#9 0x00000000009c2e66 in AgentInit::InitBase() ()
#10 0x0000000000dd5c1f in TaskTrigger::WorkerTask::Run() ()
#11 0x0000000000dd2830 in TaskImpl::execute() ()
#12 0x00007fad260d4b3a in ?? () from /usr/lib/libtbb.so.2
#13 0x00007fad260d0816 in ?? () from /usr/lib/libtbb.so.2
#14 0x00007fad260cff4b in ?? () from /usr/lib/libtbb.so.2
#15 0x00007fad260cc0ff in ?? () from /usr/lib/libtbb.so.2
#16 0x00007fad260cc2f9 in ?? () from /usr/lib/libtbb.so.2
#17 0x00007fad262f0182 in start_thread (arg=0x7fad1e38a700) at pthread_create.c:312
#18 0x00007fad255c947d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
(gdb)

Setup
------------
host1 = 'root@10.84.30.44'
host2 = 'root@10.84.30.45'
host3 = 'root@10.84.30.43'

#Role definition of the hosts.
env.roledefs = {
    'all': [host1, host2, host3],
    'cfgm': [host1],
    'openstack': [host1],
    'control': [host1],
    'compute': [host2, host1, host3],
    'collector': [host1],
    'webui': [host1],
    'database': [host1],
    'build': [host_build],
    'tsn': [host2, host3],
    'toragent': [host2, host3],
}

env.hostnames = {
    'all': ['a2s4', 'a2s5', 'a2s3']
}

Revision history for this message
chhandak (chhandak) wrote :
Changed in juniperopenstack:
importance: Undecided → High
Revision history for this message
Hari Prasad Killi (haripk) wrote :

This is seen when HTTP port is already used by another instance. Sandesh team can decide whether to retain the assert or change it to an exit.

tags: added: analytics
removed: vrouter
chhandak (chhandak)
description: updated
tags: added: releasenote
information type: Proprietary → Public
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.22-dev

Review in progress for https://review.opencontrail.org/14022
Submitter: Megh Bhatt (<email address hidden>)

Revision history for this message
Megh Bhatt (meghb) wrote :

Following commit was done with wrong bug-id:

Reviewed: https://review.opencontrail.org/13892
Committed: http://github.org/Juniper/contrail-sandesh/commit/56981efdb83120cdff0f668d323113cbdb804b6b
Submitter: Zuul
Branch: master

commit 56981efdb83120cdff0f668d323113cbdb804b6b
Author: Megh Bhatt <email address hidden>
Date: Wed Sep 16 10:40:42 2015 -0700

Return failure from InitGenerator instead of asserting if sandesh
HTTP initialization fails.
Partial-Bug: #1433668

Change-Id: I86acb9d4c60b6c3747018588f88a0d43188929a9
(cherry picked from commit 1c2c85e8a37f9e02c5a08eff3ac64281fae05ef0)

Revision history for this message
Megh Bhatt (meghb) wrote :

Following commit was done with wrong bug-id:

Reviewed: https://review.opencontrail.org/13872
Committed: http://github.org/Juniper/contrail-sandesh/commit/1c2c85e8a37f9e02c5a08eff3ac64281fae05ef0
Submitter: Zuul
Branch: R2.22-dev

commit 1c2c85e8a37f9e02c5a08eff3ac64281fae05ef0
Author: Megh Bhatt <email address hidden>
Date: Wed Sep 16 10:40:42 2015 -0700

Return failure from InitGenerator instead of asserting if sandesh
HTTP initialization fails.
Partial-Bug: #1433668

Change-Id: I86acb9d4c60b6c3747018588f88a0d43188929a9

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/14022
Committed: http://github.org/Juniper/contrail-controller/commit/7d1192720f6a69deee552c3ce518ec22bdf4f4a7
Submitter: Zuul
Branch: R2.22-dev

commit 7d1192720f6a69deee552c3ce518ec22bdf4f4a7
Author: Megh Bhatt <email address hidden>
Date: Wed Sep 23 15:49:03 2015 -0700

Check the return value of Sandesh::InitGenerator and exit if sandesh
initialization fails. Added kafka timer shutdown in contrail-query-engine
shutdown. Increased the startsecs time for contrail-dns since it was
taking around 7 secs for it to exit and hence supervisor needs to wait
for that much time to declare it up. Tested by returning false from
sandesh HTTP initialization.
Closes-Bug: #1474258

Change-Id: Ie1a9d62dc53d8fe9f28b537130d9e03b5fba2e89

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/14091
Submitter: Megh Bhatt (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/14091
Committed: http://github.org/Juniper/contrail-controller/commit/6a68d65473a2bc6baff5b52cd58d0ae1ed8f2714
Submitter: Zuul
Branch: master

commit 6a68d65473a2bc6baff5b52cd58d0ae1ed8f2714
Author: Megh Bhatt <email address hidden>
Date: Wed Sep 23 15:49:03 2015 -0700

Check the return value of Sandesh::InitGenerator and exit if sandesh
initialization fails. Added kafka timer shutdown in contrail-query-engine
shutdown. Increased the startsecs time for contrail-dns since it was
taking around 7 secs for it to exit and hence supervisor needs to wait
for that much time to declare it up. Tested by returning false from
sandesh HTTP initialization.
Closes-Bug: #1474258

Conflicts:
 src/control-node/main.cc
 src/query_engine/qed.cc

Change-Id: Ie1a9d62dc53d8fe9f28b537130d9e03b5fba2e89
(cherry picked from commit 7d1192720f6a69deee552c3ce518ec22bdf4f4a7)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.20

Review in progress for https://review.opencontrail.org/15093
Submitter: Megh Bhatt (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/15093
Committed: http://github.org/Juniper/contrail-sandesh/commit/530cd9875370e855fd392c551478556786b22824
Submitter: Zuul
Branch: R2.20

commit 530cd9875370e855fd392c551478556786b22824
Author: Megh Bhatt <email address hidden>
Date: Wed Sep 16 10:40:42 2015 -0700

Return failure from InitGenerator instead of asserting if sandesh
HTTP initialization fails.
Partial-Bug: #1474258

Change-Id: I86acb9d4c60b6c3747018588f88a0d43188929a9
(cherry picked from commit 1c2c85e8a37f9e02c5a08eff3ac64281fae05ef0)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.20

Review in progress for https://review.opencontrail.org/15157
Submitter: Megh Bhatt (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/15157
Committed: http://github.org/Juniper/contrail-controller/commit/9702ef04e0c1aa38cb7eb824c6f3d51df97a49dc
Submitter: Zuul
Branch: R2.20

commit 9702ef04e0c1aa38cb7eb824c6f3d51df97a49dc
Author: Megh Bhatt <email address hidden>
Date: Wed Sep 23 15:49:03 2015 -0700

Check the return value of Sandesh::InitGenerator and exit if sandesh
initialization fails. Added kafka timer shutdown in contrail-query-engine
shutdown. Increased the startsecs time for contrail-dns since it was
taking around 7 secs for it to exit and hence supervisor needs to wait
for that much time to declare it up. Tested by returning false from
sandesh HTTP initialization.
Closes-Bug: #1474258

Conflicts:
 src/analytics/main.cc
 src/control-node/main.cc
 src/query_engine/qed.cc

Change-Id: Ie1a9d62dc53d8fe9f28b537130d9e03b5fba2e89
(cherry picked from commit 7d1192720f6a69deee552c3ce518ec22bdf4f4a7)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.