Please find it below. Very interesting thing is that according to strace it segfaults during reading FTS_...INDEX_1.idb.
The second interesting thing is, that if I restart mysql instance, the script works perfectly. If server runs let's say 24 hours, backup crashes.
backup-my.cnf (tested with 128M memory also with 1GB of memory, the result is the same).
# This MySQL options file was generated by innobackupex.
# The MySQL server
[mysqld]
innodb_checksum_algorithm=innodb
innodb_log_checksum_algorithm=innodb
innodb_data_file_path=ibdata1:10M:autoextend
innodb_log_files_in_group=2
innodb_log_file_size=134217728
innodb_fast_checksum=0
innodb_page_size=16384
innodb_log_block_size=512
innodb_undo_tablespaces=0
/var/log/messages
Feb 11 00:23:39 db yum[11094]: Erased: MySQL-server
Feb 11 00:24:43 db yum[11154]: Erased: MySQL-client
Feb 11 00:25:00 db yum[11177]: Updated: openssl-1.0.1e-30.el6_6.5.x86_64
Feb 11 00:25:01 db yum[11177]: Installed: Percona-Server-shared-56-5.6.22-rel72.0.el6.x86_64
Feb 11 00:25:03 db yum[11177]: Installed: Percona-Server-client-56-5.6.22-rel72.0.el6.x86_64
Feb 11 00:25:10 db yum[11177]: Installed: Percona-Server-server-56-5.6.22-rel72.0.el6.x86_64
Feb 11 00:35:53 db yum[14190]: Installed: percona-xtrabackup-21-2.1.9-746.rhel6.x86_64
Feb 11 16:16:38 db kernel: xtrabackup_56[64910]: segfault at 0 ip (null) sp 00007f8c4d7fac98 error 14 in xtrabackup_56[400000+989000]
Feb 11 16:16:43 db abrt[64911]: Saved core dump of pid 64878 (/usr/bin/xtrabackup_56) to /var/spool/abrt/ccpp-2015-02-11-16:16:39-64878 (800116736 bytes)
Feb 11 16:16:43 db abrtd: Directory 'ccpp-2015-02-11-16:16:39-64878' creation detected
Feb 11 16:16:47 db abrtd: Package 'percona-xtrabackup-21' isn't signed with proper key
Feb 11 16:16:47 db abrtd: 'post-create' on '/var/spool/abrt/ccpp-2015-02-11-16:16:39-64878' exited with 1
Feb 11 16:16:47 db abrtd: Corrupted or bad directory /var/spool/abrt/ccpp-2015-02-11-16:16:39-64878, deleting
Feb 11 17:11:30 db kernel: xtrabackup_56[10892]: segfault at 0 ip (null) sp 00007fb95ebfcc98 error 14 in xtrabackup_56[400000+989000]
Feb 11 17:11:34 db abrt[11154]: Saved core dump of pid 10869 (/usr/bin/xtrabackup_56) to /var/spool/abrt/ccpp-2015-02-11-17:11:30-10869 (508923904 bytes)
Feb 11 17:11:34 db abrtd: Directory 'ccpp-2015-02-11-17:11:30-10869' creation detected
Feb 11 17:11:36 db abrtd: Package 'percona-xtrabackup-21' isn't signed with proper key
Feb 11 17:11:36 db abrtd: 'post-create' on '/var/spool/abrt/ccpp-2015-02-11-17:11:30-10869' exited with 1
Feb 11 17:11:36 db abrtd: Corrupted or bad directory /var/spool/abrt/ccpp-2015-02-11-17:11:30-10869, deleting
Please find it below. Very interesting thing is that according to strace it segfaults during reading FTS_...INDEX_1.idb.
The second interesting thing is, that if I restart mysql instance, the script works perfectly. If server runs let's say 24 hours, backup crashes.
backup-my.cnf (tested with 128M memory also with 1GB of memory, the result is the same).
# This MySQL options file was generated by innobackupex.
# The MySQL server checksum_ algorithm= innodb log_checksum_ algorithm= innodb data_file_ path=ibdata1: 10M:autoextend log_files_ in_group= 2 log_file_ size=134217728 fast_checksum= 0 page_size= 16384 log_block_ size=512 undo_tablespace s=0
[mysqld]
innodb_
innodb_
innodb_
innodb_
innodb_
innodb_
innodb_
innodb_
innodb_
/var/log/messages 1.0.1e- 30.el6_ 6.5.x86_ 64 Server- shared- 56-5.6. 22-rel72. 0.el6.x86_ 64 Server- client- 56-5.6. 22-rel72. 0.el6.x86_ 64 Server- server- 56-5.6. 22-rel72. 0.el6.x86_ 64 xtrabackup- 21-2.1. 9-746.rhel6. x86_64 56[64910] : segfault at 0 ip (null) sp 00007f8c4d7fac98 error 14 in xtrabackup_ 56[400000+ 989000] xtrabackup_ 56) to /var/spool/ abrt/ccpp- 2015-02- 11-16:16: 39-64878 (800116736 bytes) 02-11-16: 16:39-64878' creation detected xtrabackup- 21' isn't signed with proper key abrt/ccpp- 2015-02- 11-16:16: 39-64878' exited with 1 abrt/ccpp- 2015-02- 11-16:16: 39-64878, deleting 56[10892] : segfault at 0 ip (null) sp 00007fb95ebfcc98 error 14 in xtrabackup_ 56[400000+ 989000] xtrabackup_ 56) to /var/spool/ abrt/ccpp- 2015-02- 11-17:11: 30-10869 (508923904 bytes) 02-11-17: 11:30-10869' creation detected xtrabackup- 21' isn't signed with proper key abrt/ccpp- 2015-02- 11-17:11: 30-10869' exited with 1 abrt/ccpp- 2015-02- 11-17:11: 30-10869, deleting
Feb 11 00:23:39 db yum[11094]: Erased: MySQL-server
Feb 11 00:24:43 db yum[11154]: Erased: MySQL-client
Feb 11 00:25:00 db yum[11177]: Updated: openssl-
Feb 11 00:25:01 db yum[11177]: Installed: Percona-
Feb 11 00:25:03 db yum[11177]: Installed: Percona-
Feb 11 00:25:10 db yum[11177]: Installed: Percona-
Feb 11 00:35:53 db yum[14190]: Installed: percona-
Feb 11 16:16:38 db kernel: xtrabackup_
Feb 11 16:16:43 db abrt[64911]: Saved core dump of pid 64878 (/usr/bin/
Feb 11 16:16:43 db abrtd: Directory 'ccpp-2015-
Feb 11 16:16:47 db abrtd: Package 'percona-
Feb 11 16:16:47 db abrtd: 'post-create' on '/var/spool/
Feb 11 16:16:47 db abrtd: Corrupted or bad directory /var/spool/
Feb 11 17:11:30 db kernel: xtrabackup_
Feb 11 17:11:34 db abrt[11154]: Saved core dump of pid 10869 (/usr/bin/
Feb 11 17:11:34 db abrtd: Directory 'ccpp-2015-
Feb 11 17:11:36 db abrtd: Package 'percona-
Feb 11 17:11:36 db abrtd: 'post-create' on '/var/spool/
Feb 11 17:11:36 db abrtd: Corrupted or bad directory /var/spool/