contrail-topology failed because of connection error

[Vinoth Kannan Ganapathy]

After provisioning the HA setup with 3.0.2.0 latest build, observed that the contrail-topology failed due to the connection error.

root@b4s342:/opt/contrail/utils# contrail-status -d
== Contrail Control ==
supervisor-control: active
contrail-control active pid 8763, uptime 3:50:33
contrail-control-nodemgr active pid 8762, uptime 3:50:33
contrail-dns active pid 8764, uptime 3:50:33
contrail-named active pid 8765, uptime 3:50:33

== Contrail Analytics ==
supervisor-analytics: active
contrail-alarm-gen active pid 10709, uptime 3:50:06
contrail-analytics-api active pid 10708, uptime 3:50:06
contrail-analytics-nodemgr active pid 10703, uptime 3:50:06
contrail-collector active pid 10706, uptime 3:50:06
contrail-query-engine active pid 10707, uptime 3:50:06
contrail-snmp-collector active pid 10704, uptime 3:50:06
contrail-topology failed Exited too quickly (process log may have details)

== Contrail Config ==
supervisor-config: active
contrail-api:0 active pid 4566, uptime 3:51:47
contrail-config-nodemgr active pid 4563, uptime 3:51:47
contrail-device-manager active pid 5909, uptime 3:51:24
contrail-discovery:0 active pid 5162, uptime 3:51:38
contrail-schema active pid 4568, uptime 3:51:47
contrail-svc-monitor active pid 4984, uptime 3:51:39
ifmap active pid 4564, uptime 3:51:47

== Contrail Web UI ==
supervisor-webui: active
contrail-webui active pid 13301, uptime 3:49:31
contrail-webui-middleware active pid 13302, uptime 3:49:31

== Contrail Database ==
contrail-database: active
supervisor-database: active
contrail-database-nodemgr active pid 12042, uptime 3:59:16
kafka active pid 12044, uptime 3:59:16

== Contrail Support Services ==
supervisor-support-service: active
rabbitmq-server active pid 4758, uptime 3:51:43

root@b4s342:/opt/contrail/utils# tail -25 /var/log/contrail/contrail-topology-stdout.log
ConnectionError: bad request http://127.0.0.1:8081/analytics/uves
<Greenlet at 0x7fd103a44410: <bound method Controller.get_vrouters of <contrail_topology.controller.Controller object at 0x7fd108c4e910>>> failed with ConnectionError

Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/gevent/greenlet.py", line 327, in run
    result = self._run(*self.args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/contrail_topology/controller.py", line 68, in get_prouters
    self.analytic_api.get_prouters(True)
  File "/usr/lib/python2.7/dist-packages/contrail_topology/analytic_client.py", line 80, in get_prouters
    self.get_uves('prouters')))
  File "/usr/lib/python2.7/dist-packages/contrail_topology/analytic_client.py", line 54, in get_uves
    self.get_uve_url()))
  File "/usr/lib/python2.7/dist-packages/contrail_topology/analytic_client.py", line 29, in _get_url_json
    raise ConnectionError, "bad request " + url
ConnectionError: bad request http://127.0.0.1:8081/analytics/uves
<Greenlet at 0x7fd103a44550: <bound method Controller.get_prouters of <contrail_topology.controller.Controller object at 0x7fd108c4e910>>> failed with ConnectionError

Traceback (most recent call last):
  File "/usr/bin/contrail-topology", line 9, in <module>
    load_entry_point('contrail-topology==0.1.0', 'console_scripts', 'contrail-topology')()
  File "/usr/lib/python2.7/dist-packages/contrail_topology/main.py", line 18, in main
    controller.run()
  File "/usr/lib/python2.7/dist-packages/contrail_topology/controller.py", line 274, in run
    if self.constnt_schdlr.schedule(self.prouters):
AttributeError: 'Controller' object has no attribute 'prouters'
root@b4s342:/opt/contrail/utils# netstat -nlap | grep 8081
tcp 0 0 0.0.0.0:8081 0.0.0.0:* LISTEN 6853/haproxy
root@b4s342:/opt/contrail/utils# tail -20 /var/log/contrail/contrail-analytics-api.log
  File "/usr/lib/python2.7/dist-packages/redis/connection.py", line 94, in read
    (e.args,))
ConnectionError: Error while reading from socket: ('timed out',)

05/04/2016 09:24:42 PM [contrail-analytics-api]: Exception ConnectionError in uve stream proc. Arguments:
("Error while reading from socket: ('timed out',)",) : traceback Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/opserver/partition_handler.py", line 354, in _run
    for message in pb.listen():
  File "/usr/lib/python2.7/dist-packages/redis/client.py", line 1715, in listen
    r = self.parse_response()
  File "/usr/lib/python2.7/dist-packages/redis/client.py", line 1659, in parse_response
    response = self.connection.read_response()
  File "/usr/lib/python2.7/dist-packages/redis/connection.py", line 315, in read_response
    response = self._parser.read_response()
  File "/usr/lib/python2.7/dist-packages/redis/connection.py", line 105, in read_response
    response = self.read()
  File "/usr/lib/python2.7/dist-packages/redis/connection.py", line 94, in read
    (e.args,))
ConnectionError: Error while reading from socket: ('timed out',)

root@b4s342:/opt/contrail/utils# contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-analytics 3.0.2.0-34 34
contrail-config 3.0.2.0-34 34
contrail-config-openstack 3.0.2.0-34 34
contrail-control 3.0.2.0-34 34
contrail-dns 3.0.2.0-34 34
contrail-docs 3.0.2.0-34 34
contrail-f5 3.0.2.0-34 34
contrail-fabric-utils 3.0.2.0-34 34
contrail-heat 3.0.2.0-34 34
contrail-install-packages 3.0.2.0-34~liberty 34
contrail-lib 3.0.2.0-34 34
contrail-nodemgr 3.0.2.0-34 34
contrail-nova-networkapi 3.0.2.0-34 34
contrail-openstack 3.0.2.0-34 34
contrail-openstack-analytics 3.0.2.0-34 34
contrail-openstack-config 3.0.2.0-34 34
contrail-openstack-control 3.0.2.0-34 34
contrail-openstack-dashboard 3.0.2.0-34 34
contrail-openstack-database 3.0.2.0-34 34
contrail-openstack-webui 3.0.2.0-34 34
contrail-setup 3.0.2.0-34 34
contrail-utils 3.0.2.0-34 34
contrail-web-controller 3.0.2.0-34 34
contrail-web-core 3.0.2.0-34 34
ifmap-python-client 0.1-2 34
ifmap-server 0.3.2-1contrail2 34
neutron-plugin-contrail 3.0.2.0-34 34
nova-api 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-common 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-conductor 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-console 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-consoleauth 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-novncproxy 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-objectstore 2:12.0.1-0ubuntu1~cloud0.1contrail34
nova-scheduler 2:12.0.1-0ubuntu1~cloud0.1contrail34
python-contrail 3.0.2.0-34 34
python-neutronclient 1:3.1.0-0ubuntu1~cloud0.2contrail34
python-nova 2:12.0.1-0ubuntu1~cloud0.1contrail34