vcenter-as-compute: collector crashes @ __mpn_submul_1 when rebooted

[Sarath]

This crash observed in Sanity on R4.0 # 6
when controller nodes rebooted, this crash seen.

root@5a10s31:~#
root@5a10s31:~# contrail-status
== Contrail Control ==
supervisor-control: active
contrail-control active
contrail-control-nodemgr active
contrail-dns active
contrail-named active

== Contrail Analytics ==
supervisor-analytics: active
contrail-alarm-gen initializing (ApiServer:Config[Config sync failed] connection down)
contrail-analytics-api active
contrail-analytics-nodemgr active
contrail-collector active
contrail-query-engine active
contrail-snmp-collector active
contrail-topology active

== Contrail Config ==
supervisor-config: active
contrail-api:0 active
contrail-config-nodemgr active
contrail-device-manager active
contrail-schema backup
contrail-svc-monitor active

== Contrail Web UI ==
supervisor-webui: active
contrail-webui active
contrail-webui-middleware active

== Contrail Database ==
contrail-database: active

supervisor-database: active
contrail-database-nodemgr active
kafka active

== Contrail Support Services ==
supervisor-support-service: active
rabbitmq-server active

========Run time service failures=============
/var/crashes/core.contrail-collec.1618.5a10s31.1495145912

root@5a10s31:/var/crashes# gdb vizd core.contrail-collec.1618.5a10s31.1495145912
GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from vizd...done.

warning: core file may not match specified executable file.
[New LWP 2255]
[New LWP 2247]
[New LWP 2251]
[New LWP 2257]
[New LWP 2252]
[New LWP 2253]
[New LWP 3839]
[New LWP 2250]
[New LWP 2249]
[New LWP 3840]
[New LWP 6002]
[New LWP 2248]
[New LWP 3841]
[New LWP 5999]
[New LWP 6000]
[New LWP 3842]
[New LWP 6001]
[New LWP 1618]
[New LWP 2254]
[New LWP 2256]
[New LWP 5962]
[New LWP 5963]
[New LWP 5964]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/bin/contrail-collector'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00007efdd83f7c37 in __mpn_submul_1 () at ../sysdeps/x86_64/addmul_1.S:90
90 ../sysdeps/x86_64/addmul_1.S: No such file or directory.
(gdb) bt
#0 0x00007efdd83f7c37 in __mpn_submul_1 () at ../sysdeps/x86_64/addmul_1.S:90
#1 0x00007efdd83fb028 in drand48 () at drand48.c:27
#2 0x0000000000000000 in ?? ()
(gdb) quit
root@5a10s31:/var/crashes#

[Sarath (nsarath)]

nsarath@ubuntu-build04:/auto/cores/1691878$ ls -ltrd *
-rwxrwxrwx 1 nsarath test 24381440 May 18 16:01 Kvm-1-log.tar
-rwxrwxrwx 1 nsarath test 25282560 May 18 16:01 Esxi-2-log.tar
-rwxrwxrwx 1 nsarath test 25262080 May 18 16:01 Esxi-1-log.tar
-rwxrwxrwx 1 nsarath test 103956480 May 18 16:01 Ctrl-C-log.tar
-rwxrwxrwx 1 nsarath test 89528320 May 18 16:01 Ctrl-B-log.tar
-rwxrwxrwx 1 nsarath test 149493760 May 18 16:01 Ctrl-A-log.tar
-rwxrwxrwx 1 nsarath test 830863360 May 18 16:12 crashes.tar

[Raj Reddy (rajreddy)]

seems similar to rd_kafka issue..

[Arvind (arvindv)]

#0 0x00007efdd83f7c37 in __GI_raise (sig=sig@entry=6)
    at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00007efdd83fb028 in __GI_abort () at abort.c:89
#2 0x00000000004bc5ea in rd_kafka_crash ()
#3 0x00000000004ce172 in rd_kafka_buf_grow ()
#4 0x00000000004c5d42 in rd_kafka_broker_thread_main ()
#5 0x00000000004e5919 in _thrd_wrapper_function ()
#6 0x00007efdd9b9b184 in start_thread (arg=0x7efdcde5e700) at pthread_create.c:312
#7 0x00007efdd84bb37d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111