Unable to access TOR agent logical interfaces information from web GUI monitoring

[kalagesan]

Unable to access "Interfaces" information of tor-agent
(Monitor -> Infrastructure -> Virtual Routers -> tor-agent) in contrail 3.1.1.0-45 lab contrail setup.

Getting below error:
Error: Server data retrieval error

* Contrail version is 3.1.1.0-45.

Customer tested with 2000VN and 12000 logical interfaces issue seen.

They also tested 2000VN and 6800 logical interfaces, issue is seen.

I tested with 2000 VN and 2000 logical interface, issue is seen in my lab. I am able to replicate customer issue.

Suspect issue to be with contrail web GUI since I am able to retrieve the logical interfaces information using the introspec
from my setup

http://10.204.74.61:9011/Snh_OvsdbPhysicalPortReq?session_remote_ip=&session_remote_port=&name=

I see below errors from contrail web UI logs, screenshot is uploaded for your reference.

root@contrail60:/var/log/contrail# tail -f contrail-webui-stdout.log
02/06/2017 03:35:39 PM - debug: We got the channel:efe19afb-6dc8-4eff-9bf3-7d66573d040b by process:25575
Error: connect ECONNREFUSED
    at errnoException (net.js:905:11)
    at Object.afterConnect [as oncomplete] (net.js:896:19)
02/06/2017 03:35:43 PM - error: URL [http://:9011/Snh_VnListReq?name=] returned error [{"code":"ECONNREFUSED","errno":"ECONNREFUSED","syscall":"connect"}]
02/06/2017 03:35:43 PM - error: Unknown Discovery serviceType in sendDiscSubMessageOnDemand() : null
02/06/2017 03:35:43 PM - error: REST Server Error: Server data retrieval error
    at Object.sendServerRetrieveError (/usr/src/contrail/contrail-web-controller/webroot/common/api/infra.common.api.js:1108:17)
    at /usr/src/contrail/contrail-web-controller/webroot/monitor/infrastructure/vrouter/api/vrouternode.api.js:468:22
    at /usr/lib64/node_modules/async/lib/async.js:254:17
    at done (/usr/lib64/node_modules/async/lib/async.js:129:15)
    at /usr/lib64/node_modules/async/lib/async.js:32:16
    at /usr/lib64/node_modules/async/lib/async.js:251:21
    at doPostJsonCb (/usr/src/contrail/contrail-web-core/src/serverroot/utils/common.utils.js:770:13)
    at /usr/src/contrail/contrail-web-core/src/serverroot/utils/common.utils.js:786:13
    at APIServer.retryMakeCall (/usr/src/contrail/contrail-web-core/src/serverroot/common/rest.api.js:210:5)
    at Request.<anonymous> (/usr/src/contrail/contrail-web-core/src/serverroot/common/rest.api.js:336:18)

root@contrail60:/var/log/contrail# tail -f contrail-webui-middleware-stdout.log

02/06/2017 03:39:11 PM - debug: Created a new Job with jobName:getComputeNodeInterface
Error: getaddrinfo ENOTFOUND
    at errnoException (dns.js:37:11)
    at Object.onanswer [as oncomplete] (dns.js:124:16)
02/06/2017 03:39:11 PM - error: URL [http://undefined:9011/Snh_ItfReq?name=&type=&uuid=&vn=&mac=&ipv4_address=&ipv6_address=&parent_uuid=] returned error [{"code":"ENOTFOUND","errno":"ENOTFOUND","syscall":"getaddrinfo"}]
02/06/2017 03:39:11 PM - debug: Got notified on Job Listener Channel:e9542e6f-c1de-452a-9e45-7654e87158f4
02/06/2017 03:39:11 PM - debug: We did not find this channel:e9542e6f-c1de-452a-9e45-7654e87158f4
02/06/2017 03:39:11 PM - debug: Job 7897 completed by process: 26

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/28509
Submitter: Manoj (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/28510
Submitter: Manoj (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/28511
Submitter: Manoj (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/28510
Committed: http://github.org/Juniper/contrail-web-controller/commit/4e7edb178fc31dd9a4dc011eb72b0af81baf517b
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit 4e7edb178fc31dd9a4dc011eb72b0af81baf517b
Author: Manoj Naik <email address hidden>
Date: Tue Feb 7 18:27:55 2017 +0530

Closes-Bug: #1662138 - The ConfigData path was changed and there were references to the old path. Corrected the same.

Change-Id: Ibd565ebe5c263bcdc6034a3ff9a090963c540feb

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/28511
Committed: http://github.org/Juniper/contrail-web-controller/commit/031ed4c351575b44271447ab02db18f575748d2a
Submitter: Zuul (<email address hidden>)
Branch: master

commit 031ed4c351575b44271447ab02db18f575748d2a
Author: Manoj Naik <email address hidden>
Date: Tue Feb 7 18:27:55 2017 +0530

Closes-Bug: #1662138 - The ConfigData path was changed and there were references to the old path. Corrected the same.

Change-Id: Ibd565ebe5c263bcdc6034a3ff9a090963c540feb

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/28509
Committed: http://github.org/Juniper/contrail-web-controller/commit/a55f047a0c5dccd604ec3e1f429a4ef3d367952e
Submitter: Zuul (<email address hidden>)
Branch: R3.1.1.x

commit a55f047a0c5dccd604ec3e1f429a4ef3d367952e
Author: Manoj Naik <email address hidden>
Date: Tue Feb 7 18:27:55 2017 +0530

Closes-Bug: #1662138 - The ConfigData path was changed and there were references to the old path. Corrected the same.

Change-Id: Ibd565ebe5c263bcdc6034a3ff9a090963c540feb

[kalagesan (kalagesan)]

Hi team,

Customer is testing 3.1.2 release, they are seeing this issue in 3.1.2 release. Can this be fixed in next 3.1.2 build.

Regards,
Kannan

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/28809
Submitter: Manoj (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/28809
Committed: http://github.org/Juniper/contrail-web-controller/commit/6f6c70fddb479aac0df605aa7c9fb5c55e37c165
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit 6f6c70fddb479aac0df605aa7c9fb5c55e37c165
Author: Manoj Naik <email address hidden>
Date: Tue Feb 7 18:27:55 2017 +0530

Closes-Bug: #1662138 - The ConfigData path was changed and there were references to the old path. Corrected the same.

Change-Id: Ibd565ebe5c263bcdc6034a3ff9a090963c540feb
(cherry picked from commit 031ed4c351575b44271447ab02db18f575748d2a)