XtraBackup 2.1.2 Hangs on SST
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Percona XtraBackup moved to https://jira.percona.com/projects/PXB |
Fix Released
|
Critical
|
Alexey Kopytov | ||
2.1 |
Fix Released
|
Critical
|
Alexey Kopytov | ||
Percona XtraDB Cluster moved to https://jira.percona.com/projects/PXC |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
OS: Ubuntu 12.04 x64
XtraBackup 2.1.2 installed
root@upxdbc01:
ii percona-xtrabackup 2.1.2-611.precise Open source backup tool for InnoDB and XtraDB
ii percona-
ii percona-
ii percona-
ii percona-
Related wsrep settings:
wsrep_node_name = uxdbc01
wsrep_cluster_name = uxdbc
wsrep_debug = 1
wsrep_node_address = 192.168.56.53
wsrep_node_
wsrep_provider = /usr/lib/
wsrep_provider_
wsrep_slave_threads = 2
wsrep_sst_method = xtrabackup
wsrep_sst_
wsrep_cluster_
The second node is identical excep on some obvious wsrep_config values. AN strace of the innobackupex process shows the keepalive ping failing:
root 7489 0.0 0.0 4400 760 pts/0 S 20:57 0:00 /bin/sh /usr/bin/
mysql 8292 0.2 9.9 1496028 101084 pts/0 Sl 20:57 0:00 \_ /usr/sbin/mysqld --basedir=/usr --datadir=
mysql 8411 0.0 0.0 4400 612 pts/0 S 20:58 0:00 \_ sh -c wsrep_sst_
mysql 8412 0.0 0.1 20816 1732 pts/0 S 20:58 0:00 \_ /bin/bash -ue /usr//bin/
mysql 8423 0.0 1.4 145684 14964 pts/0 S 20:58 0:00 \_ perl /usr//bin/
mysql 8426 0.0 1.1 145684 12192 pts/0 S 20:58 0:00 | \_ perl /usr//bin/
mysql 8424 0.0 0.0 16492 912 pts/0 S 20:58 0:00 \_ nc 192.168.56.54 4444
root@upxdbc01:
Process 8426 attached - interrupt to quit
restart_
poll([{fd=4, events=
write(4, "\34\0\0\0\3select 'xtrabackup ping 61'", 32) = 32
read(4, "\1\0\0\
rt_sigprocmask(
rt_sigaction(
rt_sigprocmask(
nanosleep({5, 0}, 0x7fff681915a0) = 0
poll([{fd=4, events=
write(4, "\34\0\0\0\3select 'xtrabackup ping 62'", 32) = 32
read(4, "\1\0\0\
rt_sigprocmask(
rt_sigaction(
rt_sigprocmask(
nanosleep({5, 0}, 0x7fff681915a0) = 0
Running the innobackupex command manually as root or mysql user seems to work fine.
Related branches
Changed in percona-xtradb-cluster: | |
status: | New → Fix Released |
Another strace output from customer:
poll([{fd=22, events= POLLIN| POLLPRI} ], 1, 0) = 0 (Timeout) 1\1(\0\ 0\2\3def\ 0\0\0\22xtrabac kup ping"..., 16384) = 90 start_keepalive s(/usr/ bin/".. ., 85) = 85 pid=17664- >17669] DB<1> \33["..., 39) = 39 start_keepalive s(/usr/ bin/".. ., 91) = 91 pid=17664- >17669] DB<1> \33["..., 39) = 39
write(22, "\34\0\0\0\3select 'xtrabackup ping 15'", 32) = 32
read(22, "\1\0\0\
write(21, "main::
write(21, "\33[4m[
read(11, 0x7fdeb6cf7000, 8192) = -1 EIO (Input/output error)
write(21, "\33[0m", 4) = 4
write(21, "main::
write(21, "\33[4m[
read(11, 0x7fdeb6cf7000, 8192) = -1 EIO (Input/output error)