collector debugging enhancements

[Megh Bhatt]

1. Received sandesh message statistics per generator - sandesh state machine queue count, queue drop level
2. Database statistics per generator - db queue count, queue drop level, dropped message stats

The above 2 are currently sent as UVE, need to send them as stats

3. Database total writes in Mb/s per generator
4. Generator summary info to include more info in introspect

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/12107
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/12107
Committed: http://github.org/Juniper/contrail-controller/commit/9000e298a0de715a09058c16bad9dac65c6b8684
Submitter: Zuul
Branch: master

commit 9000e298a0de715a09058c16bad9dac65c6b8684
Author: Megh Bhatt <email address hidden>
Date: Tue Jun 30 11:12:49 2015 -0700

Add sm_queue_count, sm_drop_level, db_queue_count, db_drop_level,
num_generators to ShowCollectorServerResp introspect.
Partial-Bug: #1469919

Change-Id: Ia7fb9bac1c7decab0b0fd63ca26841066153ece4

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/12254
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/12254
Committed: http://github.org/Juniper/contrail-controller/commit/59a875a9f0c5127f5f18c6f4ed291dcb90da4f35
Submitter: Zuul
Branch: master

commit 59a875a9f0c5127f5f18c6f4ed291dcb90da4f35
Author: Megh Bhatt <email address hidden>
Date: Tue Jul 7 16:11:43 2015 -0700

Update LINKFLAGS for libcpuinfo so that sandesh requests for
task.sandesh show up in contrail-collector and contrail-query-engine
HTTP introspect pages.
Partial-Bug: #1469919

Change-Id: I3561ca49b7a89e7a8a0c6c7413a09f0612056571

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/12406
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/12407
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/12407
Committed: http://github.org/Juniper/contrail-controller/commit/10851be770dbf1f30a5247b19bbe2002088b772f
Submitter: Zuul
Branch: R2.22-dev

commit 10851be770dbf1f30a5247b19bbe2002088b772f
Author: Megh Bhatt <email address hidden>
Date: Tue Jul 7 16:11:43 2015 -0700

Update LINKFLAGS for libcpuinfo so that sandesh requests for
task.sandesh show up in contrail-collector and contrail-query-engine
HTTP introspect pages.
Partial-Bug: #1469919

Change-Id: I3561ca49b7a89e7a8a0c6c7413a09f0612056571
(cherry picked from commit 59a875a9f0c5127f5f18c6f4ed291dcb90da4f35)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/12425
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/12406
Committed: http://github.org/Juniper/contrail-controller/commit/a226798af8ab8a0058c175f9a18df3a2f88de5c4
Submitter: Zuul
Branch: R2.22-dev

commit a226798af8ab8a0058c175f9a18df3a2f88de5c4
Author: Megh Bhatt <email address hidden>
Date: Tue Jun 30 11:12:49 2015 -0700

Add sm_queue_count, sm_drop_level, db_queue_count, db_drop_level,
num_generators to ShowCollectorServerResp introspect.
Partial-Bug: #1469919

Change-Id: Ia7fb9bac1c7decab0b0fd63ca26841066153ece4
(cherry picked from commit 9000e298a0de715a09058c16bad9dac65c6b8684)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/12425
Committed: http://github.org/Juniper/contrail-sandesh/commit/0808b1d87e60a05a44b354bd5c5c21f7c91dd4b9
Submitter: Zuul
Branch: master

commit 0808b1d87e60a05a44b354bd5c5c21f7c91dd4b9
Author: Megh Bhatt <email address hidden>
Date: Wed Jul 15 11:53:12 2015 -0700

Sandesh client SM task needs to be run exclusive to sandesh client
reader and writer tasks. The sandesh client reader task was named
io::ReaderTask which is the same as the collector reader task and
hence in high scale the sandesh client SM task would be in deferq
and not run since a lot of io::ReaderTask would always be running.
This causes collector statistics to not be sent. Fix is to rename
the sandesh client reader task to sandesh::SandeshClientReader.
Partial-Bug: #1469919

Change-Id: I728d7054d3d1d14c3fca3dc6e0d961c3090a616a

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/12472
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/12472
Committed: http://github.org/Juniper/contrail-sandesh/commit/817ffa056db4a1a23a02df7102b33d662d214fd4
Submitter: Zuul
Branch: R2.22-dev

commit 817ffa056db4a1a23a02df7102b33d662d214fd4
Author: Megh Bhatt <email address hidden>
Date: Wed Jul 15 11:53:12 2015 -0700

Sandesh client SM task needs to be run exclusive to sandesh client
reader and writer tasks. The sandesh client reader task was named
io::ReaderTask which is the same as the collector reader task and
hence in high scale the sandesh client SM task would be in deferq
and not run since a lot of io::ReaderTask would always be running.
This causes collector statistics to not be sent. Fix is to rename
the sandesh client reader task to sandesh::SandeshClientReader.
Partial-Bug: #1469919

Change-Id: I728d7054d3d1d14c3fca3dc6e0d961c3090a616a
(cherry picked from commit 0808b1d87e60a05a44b354bd5c5c21f7c91dd4b9)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/16375
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/16376
Submitter: Megh Bhatt (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/16375
Committed: http://github.org/Juniper/contrail-sandesh/commit/133059b102a052240091e3cd91eeaf8247f79bb4
Submitter: Zuul
Branch: R2.21.x

commit 133059b102a052240091e3cd91eeaf8247f79bb4
Author: Megh Bhatt <email address hidden>
Date: Wed Jul 15 11:53:12 2015 -0700

Sandesh client SM task needs to be run exclusive to sandesh client
reader and writer tasks. The sandesh client reader task was named
io::ReaderTask which is the same as the collector reader task and
hence in high scale the sandesh client SM task would be in deferq
and not run since a lot of io::ReaderTask would always be running.
This causes collector statistics to not be sent. Fix is to rename
the sandesh client reader task to sandesh::SandeshClientReader.
Partial-Bug: #1469919

Change-Id: I728d7054d3d1d14c3fca3dc6e0d961c3090a616a
(cherry picked from commit 0808b1d87e60a05a44b354bd5c5c21f7c91dd4b9)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/16376
Committed: http://github.org/Juniper/contrail-sandesh/commit/d8754afb46a119215796a535a70503dfd79bcff6
Submitter: Zuul
Branch: R2.20

commit d8754afb46a119215796a535a70503dfd79bcff6
Author: Megh Bhatt <email address hidden>
Date: Wed Jul 15 11:53:12 2015 -0700

Sandesh client SM task needs to be run exclusive to sandesh client
reader and writer tasks. The sandesh client reader task was named
io::ReaderTask which is the same as the collector reader task and
hence in high scale the sandesh client SM task would be in deferq
and not run since a lot of io::ReaderTask would always be running.
This causes collector statistics to not be sent. Fix is to rename
the sandesh client reader task to sandesh::SandeshClientReader.
Partial-Bug: #1469919

Change-Id: I728d7054d3d1d14c3fca3dc6e0d961c3090a616a
(cherry picked from commit 0808b1d87e60a05a44b354bd5c5c21f7c91dd4b9)