rsync wsrep_sst_method not working in trusty

[Chris Ricker]

I'm using the rsync and percona-xtradb-cluster-5.5 packages shipped in trusty

rsync: 3.1.0-2ubuntu0.1
percona-xtradb-cluster-server-5.5: 5.5.34-25.9+dfsg-0ubuntu4
percona-xtradb-cluster-client-5.5: 5.5.34-25.9+dfsg-0ubuntu4
percona-xtradb-cluster-common-5.5: 5.5.34-25.9+dfsg-0ubuntu4
percona-xtradb-cluster-galera-2.x: 165-0ubuntu1
percona-xtrabackup: 2.1.8-1

With this combination and wsrep_sst_method set to rsync nodes are unable to join the cluster. Attempts to join generate errors like this on the joining node:

140501 20:11:14 [Note] WSREP: Node 1 (ci-os-con3) requested state transfer from '*any*'. Selected 0 (ci-os-con1)(SYNCED) as donor.
140501 20:11:14 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 47)
140501 20:11:14 [Note] WSREP: Requesting state transfer: success, donor: 0
140501 20:11:15 [Warning] WSREP: 0 (ci-os-con1): State transfer to 1 (ci-os-con3) failed: -1 (Operation not permitted)
140501 20:11:15 [ERROR] WSREP: gcs/src/gcs_group.c:gcs_group_handle_join_msg():719: Will never receive state. Need to abort.
140501 20:11:15 [Note] WSREP: gcomm: terminating thread
140501 20:11:15 [Note] WSREP: gcomm: joining thread
140501 20:11:15 [Note] WSREP: gcomm: closing backend

and like this on the donor node:

140501 20:11:13 [Note] WSREP: Node 1 (ci-os-con3) requested state transfer from
'*any*'. Selected 0 (ci-os-con1)(SYNCED) as donor.
140501 20:11:13 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 47)
140501 20:11:13 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notifica
tion.
140501 20:11:13 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address
 '172.29.75.134:4444/rsync_sst' --auth '(null)' --socket '/var/run/mysqld/mysqld
.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --gtid '5
6d7cb81-d168-11e3-9240-4bfba61ad7b5:47''
140501 20:11:13 [Note] WSREP: sst_donor_thread signaled with 0
140501 20:11:13 [Note] WSREP: Flushing tables for SST...
140501 20:11:13 [Note] WSREP: Provider paused at 56d7cb81-d168-11e3-9240-4bfba61
ad7b5:47
140501 20:11:13 [Note] WSREP: Tables flushed.
@ERROR: setgroups failed
rsync error: error starting client-server protocol (code 5) at main.c(1653) [sen
der=3.1.0]
WSREP_SST: [ERROR] rsync returned code 5: (20140501 20:11:14.293)
140501 20:11:14 [ERROR] WSREP: Failed to read from: wsrep_sst_rsync --role 'dono
r' --address '172.29.75.134:4444/rsync_sst' --auth '(null)' --socket '/var/run/m
ysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cn
f' --gtid '56d7cb81-d168-11e3-9240-4bfba61ad7b5:47'
140501 20:11:14 [Note] WSREP: Provider resumed.
140501 20:11:14 [ERROR] WSREP: Process completed with error: wsrep_sst_rsync --r
ole 'donor' --address '172.29.75.134:4444/rsync_sst' --auth '(null)' --socket '/
var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/my
sql/my.cnf' --gtid '56d7cb81-d168-11e3-9240-4bfba61ad7b5:47': 255 (Unknown error
 255)
140501 20:11:14 [Warning] WSREP: 0 (ci-os-con1): State transfer to 1 (ci-os-con3
) failed: -1 (Operation not permitted)

Downgrading to rsync 3.09 from saucy allows the rsync SST to complete

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Mario Splivalo (mariosplivalo)]

I have just verified this, and had no issues with rsync as wsrep_sst_method. I am using percona 5.5.37 from Ubuntu Trusty and rsync 3.1.0 from trusty too. (Had to switch to rsync from xtrabackup-v2 due to ipv6 issues, as explained in Bug #1380747).