Unable to use debug symbols for mysql 5.6 on RHEL 5

[Gavin Towey]

The rpm packages provided for el5 has is built using a DWARF format that is not supported in the version of gdb included with CentOS 5.10 (GNU gdb (GDB) CentOS (7.0.1-45.el5.centos))

After installing:
Percona-Server-56-debuginfo-5.6.19-rel67.0.el5.x86_64.rpm

and running gdb on the running mysqld process, the following error is produced:

Reading symbols from /usr/sbin/mysqld...Reading symbols from /usr/lib/debug/usr/sbin/mysqld.debug...done.
done.
Dwarf Error: wrong version in compilation unit header (is 4, should be 2) [in module /usr/lib/debug/usr/sbin/mysqld.debug]

This makes gdb unusable. There are no rpm distributions for higher versions of GDB on centos and building and maintaining all the new dependencies is not really a good option. Please build el5 versions of mysql 5.6 packages which don't require a version of GDB which is unavailable on the target OS.

[Fernando Laudares Camargos (fernando-laudares)]

I was able to verify this bug on CentOS release 5.11 (Final):

$ rpm -qa |grep -i 'percona\|gdb'
gdbm-1.8.0-28.el5
Percona-Server-56-debuginfo-5.6.19-rel67.0.el5
gdbm-1.8.0-28.el5
percona-release-0.1-3
Percona-Server-client-56-5.6.19-rel67.0.el5
Percona-Server-server-56-5.6.19-rel67.0.el5
gdb-7.0.1-45.el5.centos
Percona-Server-tokudb-56-5.6.19-rel67.0.el5
Percona-Server-shared-56-5.6.19-rel67.0.el5

$ ps aux |grep mysqld
root 2388 0.0 0.1 66120 1364 ? S 09:17 0:00 /bin/sh /usr/bin/mysqld_safe --datadir=/var/lib/mysql --pid-file=/var/lib/mysql/localhost.localdomain.pid
mysql 2483 0.0 44.1 925324 453492 ? Sl 09:17 0:00 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/localhost.localdomain.err --pid-file=/var/lib/mysql/localhost.localdomain.pid
root 3470 0.0 0.0 63300 796 pts/0 R+ 11:22 0:00 grep mysqld

$ gdb --pid=2483
GNU gdb (GDB) CentOS (7.0.1-45.el5.centos)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Attaching to process 2483
Reading symbols from /usr/sbin/mysqld...Reading symbols from /usr/lib/debug/usr/sbin/mysqld.debug...done.
done.
Dwarf Error: wrong version in compilation unit header (is 4, should be 2) [in module /usr/lib/debug/usr/sbin/mysqld.debug]
(gdb)

[Laurynas Biveinis (laurynas-biveinis)]

Is this bug really invalid for 5.1 and 5.5?

[Fernando Laudares Camargos (fernando-laudares)]

I don't know about 5.1 and 5.5, but I've tested 5.6.21 and the fix is working:

$ rpm -qa |grep -i 'percona\|gdb'
gdbm-1.8.0-28.el5
Percona-Server-shared-56-5.6.21-rel70.1.el5
Percona-Server-server-56-5.6.21-rel70.1.el5
gdbm-1.8.0-28.el5
Percona-Server-client-56-5.6.21-rel70.1.el5
percona-release-0.1-3
gdb-7.0.1-45.el5.centos
Percona-Server-56-debuginfo-5.6.21-rel70.1.el5
Percona-Server-tokudb-56-5.6.21-rel70.1.el5

$ ps aux |grep mysqld
root 2388 0.0 0.1 66124 1368 ? S 12:26 0:00 /bin/sh /usr/bin/mysqld_safe --datadir=/var/lib/mysql --pid-file=/var/lib/mysql/localhost.localdomain.pid
mysql 2481 0.6 44.1 926076 453492 ? Sl 12:26 0:00 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/localhost.localdomain.err --pid-file=/var/lib/mysql/localhost.localdomain.pid
root 2766 0.0 0.0 63300 796 pts/0 R+ 12:27 0:00 grep mysqld

$ gdb --pid=2481
GNU gdb (GDB) CentOS (7.0.1-45.el5.centos)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Attaching to process 2481
Reading symbols from /usr/sbin/mysqld...Reading symbols from /usr/lib/debug/usr/sbin/mysqld.debug...done.
done.
Reading symbols from /usr/lib64/libjemalloc.so.1...done.
Loaded symbols for /usr/lib64/libjemalloc.so.1
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
[New Thread 0x2b803584b940 (LWP 2507)]
[New Thread 0x2b803580a940 (LWP 2503)]
[New Thread 0x2b8034e09940 (LWP 2502)]
[New Thread 0x2b8034408940 (LWP 2501)]
[New Thread 0x2b8033a07940 (LWP 2500)]
[New Thread 0x2b8033006940 (LWP 2499)]
[New Thread 0x2b8032605940 (LWP 2498)]
[New Thread 0x2b802fe01940 (LWP 2497)]
[New Thread 0x2b8031c04940 (LWP 2496)]
[New Thread 0x2b8031203940 (LWP 2495)]
[New Thread 0x2b8030802940 (LWP 2494)]
[New Thread 0x2b802e40a940 (LWP 2492)]
[New Thread 0x2b802da09940 (LWP 2491)]
[New Thread 0x2b802d008940 (LWP 2490)]
[New Thread 0x2b802c607940 (LWP 2489)]
[New Thread 0x2b802bc06940 (LWP 2488)]
[New Thread 0x2b802b205940 (LWP 2487)]
[New Thread 0x2b802a804940 (LWP 2486)]
[New Thread 0x2b8029e03940 (LWP 2485)]
[New Thread 0x2b8029402940 (LWP 2484)]
[New Thread 0x2b8028a01940 (LWP 2483)]
[New Thread 0x2b801d81c940 (LWP 2482)]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /usr/lib64/libaio.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libaio.so.1
Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/librt.so.1
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypt.so.1
Reading symbols from /lib64/libssl.so.6...(no debugging symbols found)...done.
Loaded symbols for...

[Tomislav Plavcic (tplavcic)]

Laurynas,

I've checked now for PS 5.1 and 5.5 on centos5 and it is ok there (see below).
I think we concluded it is related to TokuDB which is available only on 5.6.

PS 5.5 on centos5
-----------------
[vagrant@t-centos5-64 ~]$ sudo gdb --pid 4344
GNU gdb (GDB) CentOS (7.0.1-45.el5.centos)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Attaching to process 4344
Reading symbols from /usr/sbin/mysqld...Reading symbols from /usr/lib/debug/usr/sbin/mysqld.debug...done.
done.

PS 5.1 on centos5
-----------------
[vagrant@t-centos5-64 ~]$ sudo gdb --pid 4292
GNU gdb (GDB) CentOS (7.0.1-45.el5.centos)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Attaching to process 4292
Reading symbols from /usr/sbin/mysqld...Reading symbols from /usr/lib/debug/usr/sbin/mysqld.debug...done.
done.

[Shahriyar Rzayev (rzayev-sehriyar)]

Percona now uses JIRA for bug reports so this bug report is migrated to: https://jira.percona.com/browse/PS-843