2014-12-08 05:30:19 |
Vinod Nair |
bug |
|
|
added bug |
2014-12-08 05:30:33 |
Vinod Nair |
nominated for series |
|
juniperopenstack/r2.0 |
|
2014-12-08 05:30:33 |
Vinod Nair |
bug task added |
|
juniperopenstack/r2.0 |
|
2014-12-08 05:30:43 |
Vinod Nair |
juniperopenstack/r2.0: milestone |
|
r2.0-fcs |
|
2014-12-08 05:30:51 |
Vinod Nair |
juniperopenstack/r2.0: importance |
Undecided |
High |
|
2014-12-08 05:31:07 |
Vinod Nair |
juniperopenstack/r2.0: assignee |
|
Sunil Bakhru (sbakhru) |
|
2014-12-08 05:32:15 |
Vinod Nair |
description |
On a Ha cluster with 3 Openstack/cfgm nodes , on shutting down one , Query engine remains in init state.
root@cs-scale-3:~# contrail-status | grep query
contrail-query-engine initializing
contrail-status | grep query
contrail-query-engine initializing
looks like ebenthough teh config has 3 Cassandra nodes , it is still trying to connect to 1
root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine.log
2014-12-07 Sun 07:26:17:449.297 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb69e0
2014-12-07 Sun 07:26:17:449.321 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS...
2014-12-07 Sun 07:26:17:449.347 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb7260
2014-12-07 Sun 07:26:17:449.359 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS...
2014-12-07 Sun 08:01:11:998.110 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968071998094 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:33156::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182
2014-12-07 Sun 08:08:29:628.355 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968509628320 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:51924::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182
2014-12-07 Sun 08:22:11:949.665 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417969331949646 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:55481::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182
^C
root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine
contrail-query-engine.log contrail-query-engine-stdout.log
root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine-stdout.log
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out |
On a Ha cluster with 3 Openstack/cfgm nodes , on shutting down one , Query engine remains in init state.
root@cs-scale-3:~# contrail-status | grep query
contrail-query-engine initializing
contrail-status | grep query
contrail-query-engine initializing
looks like ebenthough teh config has 3 Cassandra nodes , it is still trying to connect to 1
Version : contrail-analytics 2.0-11 11 Ubuntu 12.04.3 Icehouse
root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine.log
2014-12-07 Sun 07:26:17:449.297 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb69e0
2014-12-07 Sun 07:26:17:449.321 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS...
2014-12-07 Sun 07:26:17:449.347 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb7260
2014-12-07 Sun 07:26:17:449.359 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS...
2014-12-07 Sun 08:01:11:998.110 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968071998094 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:33156::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182
2014-12-07 Sun 08:08:29:628.355 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968509628320 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:51924::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182
2014-12-07 Sun 08:22:11:949.665 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417969331949646 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:55481::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182
^C
root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine
contrail-query-engine.log contrail-query-engine-stdout.log
root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine-stdout.log
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out |
|
2014-12-08 23:00:41 |
Sunil Bakhru |
juniperopenstack/r2.0: assignee |
Sunil Bakhru (sbakhru) |
Prabhakaran Ganesan (gprabhak) |
|
2014-12-08 23:00:56 |
Sunil Bakhru |
juniperopenstack: assignee |
|
Prabhakaran Ganesan (gprabhak) |
|
2014-12-08 23:10:33 |
Michael Nishimoto |
juniperopenstack: importance |
Undecided |
Critical |
|
2014-12-08 23:10:36 |
Michael Nishimoto |
juniperopenstack: importance |
Critical |
High |
|
2014-12-08 23:11:37 |
Sunil Bakhru |
juniperopenstack: assignee |
Prabhakaran Ganesan (gprabhak) |
Raj Reddy (rajreddy) |
|
2014-12-08 23:11:57 |
Sunil Bakhru |
juniperopenstack/r2.0: assignee |
Prabhakaran Ganesan (gprabhak) |
Raj Reddy (rajreddy) |
|
2014-12-08 23:44:00 |
Raj Reddy |
juniperopenstack: assignee |
Raj Reddy (rajreddy) |
c mishra (cdmishra) |
|
2014-12-08 23:44:11 |
Raj Reddy |
juniperopenstack/r2.0: assignee |
Raj Reddy (rajreddy) |
c mishra (cdmishra) |
|
2014-12-09 16:44:00 |
c mishra |
juniperopenstack: status |
New |
In Progress |
|
2014-12-09 16:44:05 |
c mishra |
juniperopenstack/r2.0: status |
New |
In Progress |
|
2014-12-09 23:37:08 |
OpenContrail Admin |
information type |
Proprietary |
Public |
|
2015-01-28 00:02:13 |
Raj Reddy |
tags |
|
analytics |
|
2015-02-02 18:35:46 |
c mishra |
juniperopenstack/r2.0: status |
In Progress |
Fix Committed |
|
2015-03-02 19:22:42 |
Raj Reddy |
juniperopenstack: milestone |
|
r2.20-fcs |
|
2015-03-30 21:43:43 |
c mishra |
juniperopenstack: milestone |
r2.20-fcs |
|
|
2015-04-29 09:09:36 |
OpenContrail Admin |
juniperopenstack: status |
In Progress |
Fix Committed |
|