Activity log for bug #1400208

Date Who What changed Old value New value Message
2014-12-08 05:30:19 Vinod Nair bug added bug
2014-12-08 05:30:33 Vinod Nair nominated for series juniperopenstack/r2.0
2014-12-08 05:30:33 Vinod Nair bug task added juniperopenstack/r2.0
2014-12-08 05:30:43 Vinod Nair juniperopenstack/r2.0: milestone r2.0-fcs
2014-12-08 05:30:51 Vinod Nair juniperopenstack/r2.0: importance Undecided High
2014-12-08 05:31:07 Vinod Nair juniperopenstack/r2.0: assignee Sunil Bakhru (sbakhru)
2014-12-08 05:32:15 Vinod Nair description On a Ha cluster with 3 Openstack/cfgm nodes , on shutting down one , Query engine remains in init state. root@cs-scale-3:~# contrail-status | grep query contrail-query-engine initializing contrail-status | grep query contrail-query-engine initializing looks like ebenthough teh config has 3 Cassandra nodes , it is still trying to connect to 1 root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine.log 2014-12-07 Sun 07:26:17:449.297 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb69e0 2014-12-07 Sun 07:26:17:449.321 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS... 2014-12-07 Sun 07:26:17:449.347 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb7260 2014-12-07 Sun 07:26:17:449.359 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS... 2014-12-07 Sun 08:01:11:998.110 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968071998094 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:33156::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182 2014-12-07 Sun 08:08:29:628.355 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968509628320 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:51924::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182 2014-12-07 Sun 08:22:11:949.665 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417969331949646 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:55481::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182 ^C root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine contrail-query-engine.log contrail-query-engine-stdout.log root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine-stdout.log Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out On a Ha cluster with 3 Openstack/cfgm nodes , on shutting down one , Query engine remains in init state. root@cs-scale-3:~# contrail-status | grep query contrail-query-engine initializing contrail-status | grep query contrail-query-engine initializing looks like ebenthough teh config has 3 Cassandra nodes , it is still trying to connect to 1 Version : contrail-analytics 2.0-11 11 Ubuntu 12.04.3 Icehouse root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine.log 2014-12-07 Sun 07:26:17:449.297 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb69e0 2014-12-07 Sun 07:26:17:449.321 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS... 2014-12-07 Sun 07:26:17:449.347 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: RAC_Connect status: 0 0x1fb7260 2014-12-07 Sun 07:26:17:449.359 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: Connected to REDIS... 2014-12-07 Sun 08:01:11:998.110 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968071998094 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:33156::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182 2014-12-07 Sun 08:08:29:628.355 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417968509628320 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:51924::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182 2014-12-07 Sun 08:22:11:949.665 PST cs-scale-3 [Thread 140559956899648, Pid 4810]: SANDESH: Send FAILED: 1417969331949646 TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 127.0.0.1:55481::127.0.0.1:8086(-1) < Active session connection complete controller/src/io/tcp_session.cc 182 ^C root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine contrail-query-engine.log contrail-query-engine-stdout.log root@cs-scale-3:~# tail -f /var/log/contrail/contrail-query-engine-stdout.log Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out Thrift: Sun Dec 7 21:23:59 2014 TSocketPool::open failed <Host: 13.1.0.1 Port: 9160>: connect() failed: Connection timed out
2014-12-08 23:00:41 Sunil Bakhru juniperopenstack/r2.0: assignee Sunil Bakhru (sbakhru) Prabhakaran Ganesan (gprabhak)
2014-12-08 23:00:56 Sunil Bakhru juniperopenstack: assignee Prabhakaran Ganesan (gprabhak)
2014-12-08 23:10:33 Michael Nishimoto juniperopenstack: importance Undecided Critical
2014-12-08 23:10:36 Michael Nishimoto juniperopenstack: importance Critical High
2014-12-08 23:11:37 Sunil Bakhru juniperopenstack: assignee Prabhakaran Ganesan (gprabhak) Raj Reddy (rajreddy)
2014-12-08 23:11:57 Sunil Bakhru juniperopenstack/r2.0: assignee Prabhakaran Ganesan (gprabhak) Raj Reddy (rajreddy)
2014-12-08 23:44:00 Raj Reddy juniperopenstack: assignee Raj Reddy (rajreddy) c mishra (cdmishra)
2014-12-08 23:44:11 Raj Reddy juniperopenstack/r2.0: assignee Raj Reddy (rajreddy) c mishra (cdmishra)
2014-12-09 16:44:00 c mishra juniperopenstack: status New In Progress
2014-12-09 16:44:05 c mishra juniperopenstack/r2.0: status New In Progress
2014-12-09 23:37:08 OpenContrail Admin information type Proprietary Public
2015-01-28 00:02:13 Raj Reddy tags analytics
2015-02-02 18:35:46 c mishra juniperopenstack/r2.0: status In Progress Fix Committed
2015-03-02 19:22:42 Raj Reddy juniperopenstack: milestone r2.20-fcs
2015-03-30 21:43:43 c mishra juniperopenstack: milestone r2.20-fcs
2015-04-29 09:09:36 OpenContrail Admin juniperopenstack: status In Progress Fix Committed