collectd is not built with symbols nore is the debuginfo rpm with symbols built by the build system making it difficult to debug the issue from the coredump.
controller-0:~$ sudo gdb /usr/sbin/collectd ./controller-0_2020-04-12_02-47-56_core.collectd.0.030bf5affac94ebdb55618230c994ca9.2520.1586659659000000
Password:
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-114.el7
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /usr/sbin/collectd...Reading symbols from /usr/sbin/collectd...(no debugging symbols found)...done.
(no debugging symbols found)...done.
[New LWP 3185]
[New LWP 3192]
[New LWP 3186]
[New LWP 3188]
[New LWP 3194]
[New LWP 3189]
[New LWP 3187]
[New LWP 3191]
[New LWP 3190]
[New LWP 3193]
[New LWP 2520]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/sbin/collectd'.
Program terminated with signal 6, Aborted.
#0 0x00007f53ceae9207 in raise () from /lib64/libc.so.6
Missing separate debuginfos, use: debuginfo-install collectd-5.8.1-4.el7.x86_64
daemon.log contains some traceback but there is nothing in the traceback that pinpoints the plugin or place in plugin where he traceback occured.
33373 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info ======= Backtrace: =========
33374 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /lib64/libc.so.6(+0x81489)[0x7f53ceb34489]
33375 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/lib64/collectd/network.so(+0x3445)[0x7f53ce6a5445]
33376 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/lib64/collectd/network.so(+0x3585)[0x7f53ce6a5585]
33377 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/lib64/collectd/network.so(+0x5afe)[0x7f53ce6a7afe]
33378 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/lib64/collectd/network.so(+0x5fb7)[0x7f53ce6a7fb7]
33379 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/lib64/collectd/network.so(+0x6aed)[0x7f53ce6a8aed]
33380 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/sbin/collectd(plugin_write+0xf4)[0x5622b87dce14]
33381 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/sbin/collectd(+0x9b8d)[0x5622b87d8b8d]
33382 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/sbin/collectd(+0xd005)[0x5622b87dc005]
33383 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /usr/sbin/collectd(+0xf4d7)[0x5622b87de4d7]
33384 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /lib64/libpthread.so.0(+0x7dd5)[0x7f53cf290dd5]
33385 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info /lib64/libc.so.6(clone+0x6d)[0x7f53cebb0ead]
33386 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info ======= Memory map: ========
33387 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info 5622b87cf000-5622b8803000 r-xp 00000000 08:03 1058906 /usr/sbin/collectd
33388 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info 5622b8a02000-5622b8a03000 r--p 00033000 08:03 1058906 /usr/sbin/collectd
33389 2020-04-12T02:47:39.161 controller-0 collectd[2520]: info 5622b8a03000-5622b8a04000 rw-p 00034000 08:03 1058906 /usr/sbin/collectd
[snip other lib dependencies]
33848 2020-04-12T02:47:39.162 controller-0 collectd[2520]: info 7f53cf9c5000-7f53cf9c8000 rw-p 00000000 00:00 0
33849 2020-04-12T02:47:39.162 controller-0 collectd[2520]: info 7f53cf9c8000-7f53cf9c9000 r--p 00021000 08:03 1048991 /usr/lib64/ld-2.17.so
33850 2020-04-12T02:47:39.162 controller-0 collectd[2520]: info 7f53cf9c9000-7f53cf9ca000 rw-p 00022000 08:03 1048991 /usr/lib64/ld-2.17.so
33851 2020-04-12T02:47:39.162 controller-0 collectd[2520]: info 7f53cf9ca000-7f53cf9cb000 rw-p 00000000 00:00 0
33852 2020-04-12T02:47:39.162 controller-0 collectd[2520]: info 7ffcdcac4000-7ffcdcae5000 rw-p 00000000 00:00 0 [stack]
33853 2020-04-12T02:47:39.163 controller-0 collectd[2520]: info 7ffcdcb9f000-7ffcdcba1000 r-xp 00000000 00:00 0 [vdso]
33854 2020-04-12T02:47:39.163 controller-0 collectd[2520]: info ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
33855 2020-04-12T02:47:56.863 controller-0 collectd[2520]: info =====
33856 2020-04-12T02:47:56.863 controller-0 systemd[1]: notice collectd.service: main process exited, code=killed, status=6/ABRT
33857 2020-04-12T02:47:56.874 controller-0 systemd[1]: notice Unit collectd.service entered failed state.
33858 2020-04-12T02:47:56.874 controller-0 systemd[1]: warning collectd.service failed.
33859 2020-04-12T02:48:03.701 controller-0 systemd[1]: info Reloading.
33860 2020-04-12T02:48:03.764 controller-0 systemd[1]: info Reloading.
33861 2020-04-12T02:48:11.450 controller-0 systemd[1]: info Reloading System Logger Daemon.
33862 2020-04-12T02:48:11.466 controller-0 systemd[1]: info Reloaded System Logger Daemon.
33863 2020-04-12T02:48:20.322 controller-0 systemd[1]: info Got automount request for /proc/sys/fs/binfmt_misc, triggered by 74663 (sysctl)
33864 2020-04-12T02:48:20.332 controller-0 systemd[1]: info Mounting Arbitrary Executable File Formats File System...
33865 2020-04-12T02:48:20.341 controller-0 systemd[1]: info Mounted Arbitrary Executable File Formats File System.
33866 2020-04-12T02:48:22.939 controller-0 systemd[1]: info Reloading.
33867 2020-04-12T02:48:23.010 controller-0 systemd[1]: warning Cannot add dependency job for unit dev-hugepages.mount, ignoring: Unit is masked.
33868 2020-04-12T02:48:23.011 controller-0 systemd[1]: info Stopping Synchronize system clock or PTP hardware clock (PHC)...
33869 2020-04-12T02:48:23.051 controller-0 systemd[1]: info Stopped Synchronize system clock or PTP hardware clock (PHC).
33870 2020-04-12T02:48:23.066 controller-0 systemd[1]: info Starting Synchronize system clock or PTP hardware clock (PHC)...
33871 2020-04-12T02:48:23.074 controller-0 systemd[1]: info Started Synchronize system clock or PTP hardware clock (PHC).
collectd is not built with symbols nore is the debuginfo rpm with symbols built by the build system making it difficult to debug the issue from the coredump.
controller-0:~$ sudo gdb /usr/sbin/collectd ./controller- 0_2020- 04-12_02- 47-56_core. collectd. 0.030bf5affac94 ebdb55618230c99 4ca9.2520. 158665965900000 0 gnu.org/ licenses/ gpl.html> redhat- linux-gnu" . www.gnu. org/software/ gdb/bugs/>... collectd. ..Reading symbols from /usr/sbin/ collectd. ..(no debugging symbols found)...done. libthread_ db.so.1" . collectd' . 5.8.1-4. el7.x86_ 64
Password:
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-114.el7
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-
For bug reporting instructions, please see:
<http://
Reading symbols from /usr/sbin/
(no debugging symbols found)...done.
[New LWP 3185]
[New LWP 3192]
[New LWP 3186]
[New LWP 3188]
[New LWP 3194]
[New LWP 3189]
[New LWP 3187]
[New LWP 3191]
[New LWP 3190]
[New LWP 3193]
[New LWP 2520]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/
Core was generated by `/usr/sbin/
Program terminated with signal 6, Aborted.
#0 0x00007f53ceae9207 in raise () from /lib64/libc.so.6
Missing separate debuginfos, use: debuginfo-install collectd-
daemon.log contains some traceback but there is nothing in the traceback that pinpoints the plugin or place in plugin where he traceback occured.
33373 2020-04- 12T02:47: 39.161 controller-0 collectd[2520]: info ======= Backtrace: ========= 12T02:47: 39.161 controller-0 collectd[2520]: info /lib64/ libc.so. 6(+0x81489) [0x7f53ceb34489 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/lib64/ collectd/ network. so(+0x3445) [0x7f53ce6a5445 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/lib64/ collectd/ network. so(+0x3585) [0x7f53ce6a5585 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/lib64/ collectd/ network. so(+0x5afe) [0x7f53ce6a7afe ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/lib64/ collectd/ network. so(+0x5fb7) [0x7f53ce6a7fb7 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/lib64/ collectd/ network. so(+0x6aed) [0x7f53ce6a8aed ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/sbin/ collectd( plugin_ write+0xf4) [0x5622b87dce14 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/sbin/ collectd( +0x9b8d) [0x5622b87d8b8d ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/sbin/ collectd( +0xd005) [0x5622b87dc005 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /usr/sbin/ collectd( +0xf4d7) [0x5622b87de4d7 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /lib64/ libpthread. so.0(+0x7dd5) [0x7f53cf290dd5 ] 12T02:47: 39.161 controller-0 collectd[2520]: info /lib64/ libc.so. 6(clone+ 0x6d)[0x7f53ceb b0ead] 12T02:47: 39.161 controller-0 collectd[2520]: info ======= Memory map: ======== 12T02:47: 39.161 controller-0 collectd[2520]: info 5622b87cf000- 5622b8803000 r-xp 00000000 08:03 1058906 /usr/sbin/collectd 12T02:47: 39.161 controller-0 collectd[2520]: info 5622b8a02000- 5622b8a03000 r--p 00033000 08:03 1058906 /usr/sbin/collectd 12T02:47: 39.161 controller-0 collectd[2520]: info 5622b8a03000- 5622b8a04000 rw-p 00034000 08:03 1058906 /usr/sbin/collectd
33374 2020-04-
33375 2020-04-
33376 2020-04-
33377 2020-04-
33378 2020-04-
33379 2020-04-
33380 2020-04-
33381 2020-04-
33382 2020-04-
33383 2020-04-
33384 2020-04-
33385 2020-04-
33386 2020-04-
33387 2020-04-
33388 2020-04-
33389 2020-04-
[snip other lib dependencies]
33848 2020-04- 12T02:47: 39.162 controller-0 collectd[2520]: info 7f53cf9c5000- 7f53cf9c8000 rw-p 00000000 00:00 0 12T02:47: 39.162 controller-0 collectd[2520]: info 7f53cf9c8000- 7f53cf9c9000 r--p 00021000 08:03 1048991 /usr/lib64/ ld-2.17. so 12T02:47: 39.162 controller-0 collectd[2520]: info 7f53cf9c9000- 7f53cf9ca000 rw-p 00022000 08:03 1048991 /usr/lib64/ ld-2.17. so 12T02:47: 39.162 controller-0 collectd[2520]: info 7f53cf9ca000- 7f53cf9cb000 rw-p 00000000 00:00 0 12T02:47: 39.162 controller-0 collectd[2520]: info 7ffcdcac4000- 7ffcdcae5000 rw-p 00000000 00:00 0 [stack] 12T02:47: 39.163 controller-0 collectd[2520]: info 7ffcdcb9f000- 7ffcdcba1000 r-xp 00000000 00:00 0 [vdso] 12T02:47: 39.163 controller-0 collectd[2520]: info ffffffffff60000 0-ffffffffff601 000 r-xp 00000000 00:00 0 [vsyscall] 12T02:47: 56.863 controller-0 collectd[2520]: info ===== 12T02:47: 56.863 controller-0 systemd[1]: notice collectd.service: main process exited, code=killed, status=6/ABRT 12T02:47: 56.874 controller-0 systemd[1]: notice Unit collectd.service entered failed state. 12T02:47: 56.874 controller-0 systemd[1]: warning collectd.service failed. 12T02:48: 03.701 controller-0 systemd[1]: info Reloading. 12T02:48: 03.764 controller-0 systemd[1]: info Reloading. 12T02:48: 11.450 controller-0 systemd[1]: info Reloading System Logger Daemon. 12T02:48: 11.466 controller-0 systemd[1]: info Reloaded System Logger Daemon. 12T02:48: 20.322 controller-0 systemd[1]: info Got automount request for /proc/sys/ fs/binfmt_ misc, triggered by 74663 (sysctl) 12T02:48: 20.332 controller-0 systemd[1]: info Mounting Arbitrary Executable File Formats File System... 12T02:48: 20.341 controller-0 systemd[1]: info Mounted Arbitrary Executable File Formats File System. 12T02:48: 22.939 controller-0 systemd[1]: info Reloading. 12T02:48: 23.010 controller-0 systemd[1]: warning Cannot add dependency job for unit dev-hugepages. mount, ignoring: Unit is masked. 12T02:48: 23.011 controller-0 systemd[1]: info Stopping Synchronize system clock or PTP hardware clock (PHC)... 12T02:48: 23.051 controller-0 systemd[1]: info Stopped Synchronize system clock or PTP hardware clock (PHC). 12T02:48: 23.066 controller-0 systemd[1]: info Starting Synchronize system clock or PTP hardware clock (PHC)... 12T02:48: 23.074 controller-0 systemd[1]: info Started Synchronize system clock or PTP hardware clock (PHC).
33849 2020-04-
33850 2020-04-
33851 2020-04-
33852 2020-04-
33853 2020-04-
33854 2020-04-
33855 2020-04-
33856 2020-04-
33857 2020-04-
33858 2020-04-
33859 2020-04-
33860 2020-04-
33861 2020-04-
33862 2020-04-
33863 2020-04-
33864 2020-04-
33865 2020-04-
33866 2020-04-
33867 2020-04-
33868 2020-04-
33869 2020-04-
33870 2020-04-
33871 2020-04-