Activity log for bug #1612545

Date Who What changed Old value New value Message
2016-08-12 08:06:24 Sarath bug added bug
2016-08-12 08:06:34 Sarath nominated for series juniperopenstack/r3.1
2016-08-12 08:06:34 Sarath bug task added juniperopenstack/r3.1
2016-08-12 08:06:40 Sarath juniperopenstack/r3.1: importance Undecided High
2016-08-12 08:06:51 Sarath juniperopenstack/r3.1: assignee Raj Reddy (rajreddy)
2016-08-12 08:58:28 Sarath description upgrade from 2.21.2 to 3.1.0.0 (build#14) failed Analytics/collector. This is 3 controller nodes setup and seeing this failed on all 3 nodes and not coming up when doing service restart. root@oblocknode02:~# root@oblocknode02:~# contrail-status ssh root@172.16.80.105 == Contrail Control == supervisor-control: active contrail-control active contrail-control-nodemgr active contrail-dns active contrail-named active == Contrail Analytics == supervisor-analytics: active contrail-alarm-gen active contrail-analytics-api initializing (UvePartitions:UVE-Aggregation[Partitions:0] connection down) contrail-analytics-nodemgr active contrail-collector initializing (KafkaPub:172.16.80.2:9092,172.16.80.13:9092,172.16.80.4:9092 connection down) contrail-query-engine active contrail-snmp-collector active contrail-topology active == Contrail Config == supervisor-config: active contrail-api:0 active contrail-config-nodemgr active contrail-device-manager backup contrail-discovery:0 active contrail-schema backup contrail-svc-monitor backup contrail-vcenter-plugin active ifmap active == Contrail Web UI == supervisor-webui: active contrail-webui active contrail-webui-middleware active == Contrail Database == contrail-database: active == Contrail Supervisor Database == supervisor-database: active contrail-database-nodemgr active kafka active == Contrail Support Services == supervisor-support-service: active rabbitmq-server active upgrade from 2.21.2 to 3.1.0.0 (build#14) failed Analytics/collector. This is 3 controller nodes setup and seeing this failed on all 3 nodes and not coming up when doing service restart. root@oblocknode02:~# root@oblocknode02:~# contrail-status ssh root@172.16.80.105 == Contrail Control == supervisor-control: active contrail-control active contrail-control-nodemgr active contrail-dns active contrail-named active == Contrail Analytics == supervisor-analytics: active contrail-alarm-gen active contrail-analytics-api initializing (UvePartitions:UVE-Aggregation[Partitions:0] connection down) contrail-analytics-nodemgr active contrail-collector initializing (KafkaPub:172.16.80.2:9092,172.16.80.13:9092,172.16.80.4:9092 connection down) contrail-query-engine active contrail-snmp-collector active contrail-topology active == Contrail Config == supervisor-config: active contrail-api:0 active contrail-config-nodemgr active contrail-device-manager backup contrail-discovery:0 active contrail-schema backup contrail-svc-monitor backup contrail-vcenter-plugin active ifmap active == Contrail Web UI == supervisor-webui: active contrail-webui active contrail-webui-middleware active == Contrail Database == contrail-database: active == Contrail Supervisor Database == supervisor-database: active contrail-database-nodemgr active kafka active == Contrail Support Services == supervisor-support-service: active rabbitmq-server active ========Run time service failures============= /var/crashes/core.contrail-collec.21014.oblocknode02.1470962323 /var/crashes/core.contrail-collec.1525.oblocknode02.1470958245 [New LWP 1525] [New LWP 1622] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/usr/bin/contrail-collector'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f4a849d2cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) bt #0 0x00007f4a849d2cc9 in raise () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f4a849d60d8 in abort () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f4a849cbb86 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #3 0x00007f4a849cbc32 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6 #4 0x0000000000601a68 in ?? () #5 0x00000000005a7ab1 in ?? () #6 0x000000000059611d in ?? () #7 0x0000000000744120 in ?? () #8 0x0000000000742eae in ?? () #9 0x0000000000743615 in ?? () #10 0x00000000007411ab in ?? () #11 0x0000000000739085 in ?? () #12 0x00000000007402a7 in ?? () #13 0x000000000046a2bf in ?? () #14 0x00007f4a85f5ab3a in ?? () from /usr/lib/libtbb.so.2 #15 0x00007f4a85f56816 in ?? () from /usr/lib/libtbb.so.2 #16 0x00007f4a85f55f4b in ?? () from /usr/lib/libtbb.so.2 #17 0x00007f4a85f520ff in ?? () from /usr/lib/libtbb.so.2 #18 0x00007f4a85f522f9 in ?? () from /usr/lib/libtbb.so.2 #19 0x00007f4a86176182 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #20 0x00007f4a84a9647d in clone () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) exit
2016-08-12 16:16:53 Raj Reddy juniperopenstack: assignee Raj Reddy (rajreddy) Ranjeet R (rranjeet-n)
2016-08-12 16:17:06 Raj Reddy juniperopenstack/r3.1: assignee Raj Reddy (rajreddy) Ranjeet R (rranjeet-n)
2016-08-12 18:00:54 OpenContrail Admin juniperopenstack/r3.1: status New In Progress
2016-08-12 21:57:05 OpenContrail Admin juniperopenstack/r3.1: status In Progress Fix Committed
2016-08-12 21:57:07 OpenContrail Admin juniperopenstack/r3.1: milestone r3.1.0.0-fcs
2016-08-15 05:15:41 OpenContrail Admin nominated for series juniperopenstack/trunk
2016-08-15 05:15:41 OpenContrail Admin bug task added juniperopenstack/trunk
2016-08-15 05:15:41 OpenContrail Admin bug task added juniperopenstack/trunk
2016-08-15 19:12:51 OpenContrail Admin juniperopenstack/trunk: status In Progress Fix Committed
2016-08-15 19:12:53 OpenContrail Admin juniperopenstack/trunk: milestone r3.2.0.0-fcs