--JOINER

[root@percona3 ~]# grep dir /etc/my.cnf         
datadir=/data/myisam
innodb_data_home_dir = /data/innodb
innodb_log_group_home_dir=/data/innodb

[root@percona3 ~]# xtrabackup --version
xtrabackup version 2.3.2 based on MySQL server 5.6.24 Linux (x86_64) (revision id: 306a2e0)


2015-12-01 14:40:27 21680 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'joiner' --address '192.168.99.4:4444' --datadir '/data/myisam/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '21680' --binlog 'binlog' '
WSREP_SST: [INFO] Streaming with xbstream (20151201 14:40:28.434)
WSREP_SST: [INFO] Using socat as streamer (20151201 14:40:28.441)
WSREP_SST: [INFO] Evaluating timeout -s9 100 socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20151201 14:40:28.660)
2015-12-01 14:40:28 21680 [Note] WSREP: Prepared SST request: xtrabackup-v2|192.168.99.4:4444/xtrabackup_sst//1
...
WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20151201 14:40:30.785)
...


WSREP_SST: [INFO] Waiting for SST streaming to complete! (20151201 14:40:31.382)
2015-12-01 14:46:19 21680 [Note] WSREP: 2.0 (percona2): State transfer to 0.0 (percona3) complete.
2015-12-01 14:46:19 21680 [Note] WSREP: Member 2.0 (percona2) synced with group.
ls: cannot access binlog.*: No such file or directory
WSREP_SST: [INFO] Preparing the backup at /data/myisam//.sst (20151201 14:46:23.906)
WSREP_SST: [INFO] Evaluating innobackupex --no-version-check  --apply-log $rebuildcmd ${DATA} &>${DATA}/innobackup.prepare.log (20151201 14:46:23.912)
WSREP_SST: [INFO] Moving the backup to /data/myisam/ (20151201 14:46:32.534)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf  --defaults-group=mysqld --no-version-check   --move-back --force-non-empty-directories ${DATA} &>${DATA}/innobackup.move.log (20151201 14:46:32.536)
WSREP_SST: [INFO] Move successful, removing /data/myisam//.sst (20151201 14:46:33.054)
WSREP_SST: [INFO] Galera co-ords from recovery: fadf885a-490b-11e4-9e13-27f574d828b6:1441251 (20151201 14:46:33.065)
WSREP_SST: [INFO] Total time on joiner: 0 seconds (20151201 14:46:33.130)
WSREP_SST: [INFO] Removing the sst_in_progress file (20151201 14:46:33.135)
2015-12-01 14:46:33 21680 [Note] WSREP: SST complete, seqno: 1441251
2015-12-01 14:46:33 21680 [Note] Plugin 'FEDERATED' is disabled.
2015-12-01 14:46:33 7ff4b1c197e0 InnoDB: Warning: Using innodb_locks_unsafe_for_binlog is DEPRECATED. This option may be removed in future releases. Please use READ COMMITTED transaction isolation level instead, see http://dev.m
ysql.com/doc/refman/5.6/en/set-transaction.html.
2015-12-01 14:46:33 21680 [Note] InnoDB: Using atomics to ref count buffer pool pages
2015-12-01 14:46:33 21680 [Note] InnoDB: The InnoDB memory heap is disabled
2015-12-01 14:46:33 21680 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2015-12-01 14:46:33 21680 [Note] InnoDB: Memory barrier is not used
2015-12-01 14:46:33 21680 [Note] InnoDB: Compressed tables use zlib 1.2.3
2015-12-01 14:46:33 21680 [Note] InnoDB: Using Linux native AIO
2015-12-01 14:46:33 21680 [Note] InnoDB: Not using CPU crc32 instructions
2015-12-01 14:46:33 21680 [Note] InnoDB: Initializing buffer pool, size = 128.0M
2015-12-01 14:46:33 21680 [Note] InnoDB: Completed initialization of buffer pool
2015-12-01 14:46:33 21680 [Note] InnoDB: The first specified data file /data/innodb/ibdata1 did not exist: a new database to be created!
2015-12-01 14:46:33 21680 [Note] InnoDB: Setting file /data/innodb/ibdata1 size to 12 MB
2015-12-01 14:46:33 21680 [Note] InnoDB: Database physically writes the file full: wait...
2015-12-01 14:46:33 21680 [Note] InnoDB: Setting log file /data/innodb/ib_logfile101 size to 256 MB
InnoDB: Progress in MB: 100 200
2015-12-01 14:46:34 21680 [Note] InnoDB: Setting log file /data/innodb/ib_logfile1 size to 256 MB
InnoDB: Progress in MB: 100 200
...
2015-12-01 14:46:37 21680 [ERROR] Unknown/unsupported storage engine: InnoDB
2015-12-01 14:46:37 21680 [ERROR] Aborting


[root@percona3 ~]# ls -lh /data/innodb/
total 525M
-rw-rw---- 1 mysql mysql  12M Dec  1 14:46 ibdata1
-rw-rw---- 1 mysql mysql 256M Dec  1 14:46 ib_logfile1
-rw-rw---- 1 mysql mysql 256M Dec  1 14:46 ib_logfile101
[root@percona3 ~]# ls -lh /data/myisam/ib*
-rw-rw---- 1 mysql mysql  76M Dec  1 14:46 /data/myisam/ibdata1
-rw-rw---- 1 mysql mysql 256M Dec  1 14:46 /data/myisam/ib_logfile0
-rw-rw---- 1 mysql mysql 256M Dec  1 14:46 /data/myisam/ib_logfile1

-- so the correct ibdata1 ^ was copied to datadir instead of innodb_data_home_dir

151201 14:46:23 innobackupex: Starting the apply-log operation

IMPORTANT: Please check that the apply-log run completes successfully.
           At the end of a successful apply-log run innobackupex
           prints "completed OK!".

innobackupex version 2.3.2 based on MySQL server 5.6.24 Linux (x86_64) (revision id: 306a2e0)
xtrabackup: cd to /data/myisam//.sst
xtrabackup: This target seems to be not prepared yet.
xtrabackup: xtrabackup_logfile detected: size=2097152, start_lsn=(4822683822)
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup:   innodb_data_home_dir = ./
xtrabackup:   innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup:   innodb_log_group_home_dir = ./
xtrabackup:   innodb_log_files_in_group = 1
xtrabackup:   innodb_log_file_size = 2097152
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup:   innodb_data_home_dir = ./
xtrabackup:   innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup:   innodb_log_group_home_dir = ./
xtrabackup:   innodb_log_files_in_group = 1
...
xtrabackup: using the following InnoDB configuration for recovery:
xtrabackup:   innodb_data_home_dir = ./
xtrabackup:   innodb_data_file_path = ibdata1:10M:autoextend
xtrabackup:   innodb_log_group_home_dir = ./
xtrabackup:   innodb_log_files_in_group = 2
xtrabackup:   innodb_log_file_size = 268435456
...
InnoDB: Shutdown completed; log sequence number 4822684182
151201 14:46:32 completed OK!


-- DONOR

[root@percona2 ~]# grep dir /etc/my.cnf 
datadir=/data/myisam
#wsrep_dirty_reads = 1
innodb_data_home_dir = /data/innodb
innodb_log_group_home_dir=/data/innodb

[root@percona2 ~]# xtrabackup --version
xtrabackup version 2.3.2 based on MySQL server 5.6.24 Linux (x86_64) (revision id: 306a2e0)

percona2 mysql> select @@version,@@version_comment\G
*************************** 1. row ***************************
        @@version: 5.6.26-74.0-56-log
@@version_comment: Percona XtraDB Cluster (GPL), Release rel74.0, Revision 1, WSREP version 25.12, wsrep_25.12
1 row in set (0.00 sec)


2015-12-01 14:40:23 19343 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'donor' --address '192.168.99.4:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/data/myisam/' --defaults-file '/etc/my.cnf' --defaults-group-suffix ''  --binlog 'percona2-bin' --gtid 'fadf885a-490b-11e4-9e13-27f574d828b6:1441251''
...
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/my.cnf  --defaults-group=mysqld --no-version-check  $tmpopts $INNOEXTRA --galera-info --stream=$sfmt $itmpdir 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:192.168.99.4:4444; RC=( ${PIPESTATUS[@]} ) (20151201 14:40:35.488)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20151201 14:46:14.445)
WSREP_SST: [INFO] Cleaning up temporary directories (20151201 14:46:14.456)
2015-12-01 14:46:14 19343 [Note] WSREP: 2.0 (percona2): State transfer to 0.0 (percona3) complete.


innobackup.backup.log:

151201 14:40:35 innobackupex: Starting the backup operation

IMPORTANT: Please check that the backup run completes successfully.
           At the end of a successful backup run innobackupex
           prints "completed OK!".

151201 14:40:35 Connecting to MySQL server host: localhost, user: root, password: not set, port: 0, socket: /var/lib/mysql/mysql.sock
Using server version 5.6.26-74.0-56-log
innobackupex version 2.3.2 based on MySQL server 5.6.24 Linux (x86_64) (revision id: 306a2e0)
xtrabackup: uses posix_fadvise().
xtrabackup: cd to /data/myisam
xtrabackup: open files limit requested 65535, set to 65535
xtrabackup: using the following InnoDB configuration:
xtrabackup:   innodb_data_home_dir = /data/innodb
xtrabackup:   innodb_data_file_path = ibdata1:12M:autoextend
xtrabackup:   innodb_log_group_home_dir = /data/innodb
xtrabackup:   innodb_log_files_in_group = 2
xtrabackup:   innodb_log_file_size = 268435456
xtrabackup: using O_DIRECT
151201 14:40:35 >> log scanned up to (4822683822)
InnoDB: Opened 2 undo tablespaces
xtrabackup: Generating a list of tablespaces
151201 14:40:36 >> log scanned up to (4822683822)
xtrabackup: Starting 2 threads for parallel data files transfer
151201 14:40:37 [02] Streaming /data/innodb/ibdata1
...
xtrabackup: Transaction log of lsn (4822683822) to (4822683857) was copied.
151201 14:46:14 completed OK!