node 1 2017-03-02T17:22:16.390710Z 0 [Note] WSREP: (507b3843, 'tcp://0.0.0.0:4567') connection established to c854375a tcp://node2IP:4567 2017-03-02T17:22:16.390943Z 0 [Note] WSREP: (507b3843, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 2017-03-02T17:22:16.516765Z 60 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:16.519287Z 60 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:16.519421Z 0 [Note] WSREP: declaring 656c6320 at tcp://garbdIP:4567 stable 2017-03-02T17:22:16.519435Z 0 [Note] WSREP: declaring c854375a at tcp://node2IP:4567 stable 2017-03-02T17:22:16.519832Z 0 [Note] WSREP: Node 507b3843 state prim 2017-03-02T17:22:16.520178Z 0 [Note] WSREP: view(view_id(PRIM,507b3843,321) memb { 507b3843,0 656c6320,0 c854375a,0 } joined { } left { } partitioned { }) 2017-03-02T17:22:16.520200Z 0 [Note] WSREP: save pc into disk 2017-03-02T17:22:16.520728Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2017-03-02T17:22:16.521163Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c86849bb-ff6c-11e6-a86a-92ba08adbcfb 2017-03-02T17:22:16.521591Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb 2017-03-02T17:22:16.521862Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb from 0 (node1) 2017-03-02T17:22:16.521869Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb from 1 (garb) 2017-03-02T17:22:16.890757Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb from 2 (node2) 2017-03-02T17:22:16.890793Z 0 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 318, members = 2/3 (joined/total), act_id = 24295099, last_appl. = 24295040, protocols = 0/7/3 (gcs/repl/appl), group UUID = 40746209-d716-11e6-9299-6e180a3e767e 2017-03-02T17:22:16.890806Z 0 [Note] WSREP: Flow-control interval: [28, 28] 2017-03-02T17:22:16.890942Z 11 [Note] WSREP: New cluster view: global state: 40746209-d716-11e6-9299-6e180a3e767e:24295099, view# 319: Primary, number of nodes: 3, my index: 0, protocol version 3 2017-03-02T17:22:16.890983Z 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2017-03-02T17:22:16.891022Z 11 [Note] WSREP: REPL Protocols: 7 (3, 2) 2017-03-02T17:22:16.896724Z 11 [Note] WSREP: Assign initial position for certification: 24295099, protocol version: 3 2017-03-02T17:22:16.896849Z 0 [Note] WSREP: Service thread queue flushed. 2017-03-02T17:22:16.903296Z 60 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:16.910159Z 60 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:16.910723Z 60 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:16.913377Z 60 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.330704Z 0 [Note] WSREP: Member 2.0 (node2) requested state transfer from '*any*'. Selected 0.0 (node1)(SYNCED) as donor. 2017-03-02T17:22:17.330721Z 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 24295107) 2017-03-02T17:22:17.330786Z 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2017-03-02T17:22:17.331502Z 0 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'donor' --address 'node2IP:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/data/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid ' 40746209-d716-11e6-9299-6e180a3e767e:24295107'' 2017-03-02T17:22:17.333311Z 11 [Note] WSREP: sst_donor_thread signaled with 0 WSREP_SST: [INFO] The xtrabackup version is 2.4.5 (20170302 17:22:17.367) 2017-03-02T17:22:17.517965Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.519731Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.521942Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_text) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.522482Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.526637Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.527149Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.528481Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.529407Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.529780Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.530537Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.532061Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.532421Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.532945Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.534736Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.535233Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.537391Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.540415Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.541510Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.546457Z 57 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:17.550170Z 57 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE WSREP_SST: [INFO] Streaming with xbstream (20170302 17:22:17.571) WSREP_SST: [INFO] Using socat as streamer (20170302 17:22:17.573) WSREP_SST: [INFO] Using /tmp/tmp.wQGlneiHuU as innobackupex temporary directory (20170302 17:22:17.583) WSREP_SST: [INFO] Streaming GTID file before SST (20170302 17:22:17.587) WSREP_SST: [INFO] Evaluating xbstream -c ${FILE_TO_STREAM} | socat -u stdio TCP:node2IP:4444; RC=( ${PIPESTATUS[@]} ) (20170302 17:22:17.590) WSREP_SST: [INFO] Sleeping before data transfer for SST (20170302 17:22:17.596) 2017-03-02T17:22:17.608927Z 0 [Note] WSREP: declaring 656c6320 at tcp://garbdIP:4567 stable 2017-03-02T17:22:17.608943Z 0 [Note] WSREP: forgetting c854375a (tcp://node2IP:4567) 2017-03-02T17:22:17.609433Z 0 [Note] WSREP: Node 507b3843 state prim 2017-03-02T17:22:17.609737Z 0 [Note] WSREP: view(view_id(PRIM,507b3843,322) memb { 507b3843,0 656c6320,0 } joined { } left { } partitioned { c854375a,0 }) 2017-03-02T17:22:17.609748Z 0 [Note] WSREP: save pc into disk 2017-03-02T17:22:17.609931Z 0 [Note] WSREP: forgetting c854375a (tcp://node2IP:4567) 2017-03-02T17:22:17.610012Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2017-03-02T17:22:17.610436Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: c90e7fc7-ff6c-11e6-a05b-96b135680f70 2017-03-02T17:22:17.610647Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: c90e7fc7-ff6c-11e6-a05b-96b135680f70 2017-03-02T17:22:17.610883Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c90e7fc7-ff6c-11e6-a05b-96b135680f70 from 0 (node1) 2017-03-02T17:22:17.610888Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c90e7fc7-ff6c-11e6-a05b-96b135680f70 from 1 (garb) 2017-03-02T17:22:17.610895Z 0 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 319, members = 2/2 (joined/total), act_id = 24295120, last_appl. = 24295040, protocols = 0/7/3 (gcs/repl/appl), group UUID = 40746209-d716-11e6-9299-6e180a3e767e 2017-03-02T17:22:17.610901Z 0 [Note] WSREP: Flow-control interval: [23, 23] 2017-03-02T17:22:17.611071Z 7 [Note] WSREP: New cluster view: global state: 40746209-d716-11e6-9299-6e180a3e767e:24295120, view# 320: Primary, number of nodes: 2, my index: 0, protocol version 3 2017-03-02T17:22:17.611117Z 7 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2017-03-02T17:22:17.611138Z 7 [Note] WSREP: REPL Protocols: 7 (3, 2) 2017-03-02T17:22:17.612171Z 7 [Note] WSREP: Assign initial position for certification: 24295120, protocol version: 3 2017-03-02T17:22:17.612210Z 0 [Note] WSREP: Service thread queue flushed. WSREP_SST: [INFO] Streaming the backup to joiner at node2IP 4444 (20170302 17:22:27.599) WSREP_SST: [INFO] Evaluating xtrabackup --defaults-file=/etc/my.cnf --defaults-group=mysqld --no-backup-locks $tmpopts $INNOEXTRA $keyringbackupopt --backup --galera-info --binlog-info=ON --stream=$sfmt --target-dir=$itmpdir 2>${DATA}/innobackup.backup.log | socat -u st dio TCP:node2IP:4444; RC=( ${PIPESTATUS[@]} ) (20170302 17:22:27.602) 2017/03/02 17:22:27 socat[137985] E connect(3, AF=2 node2IP:4444, 16): Connection refused 2017-03-02T17:22:27.653886Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:27.656214Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:27.660416Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_text) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:27.662345Z 69 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:27.665436Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_text) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:27.667390Z 58 [Warning] WSREP: Percona-XtraDB-Cluster doesn't recommend use of DML command on a table (zabbix.history_uint) without an explicit primary key with pxc_strict_mode = PERMISSIVE 2017-03-02T17:22:28.059569Z 813286 [Note] Aborted connection 813286 to db: 'unconnected' user: 'sstuser' host: 'localhost' (Got an error reading communication packets) WSREP_SST: [ERROR] xtrabackup finished with error: 1. Check /data/mysql//innobackup.backup.log (20170302 17:22:28.061) WSREP_SST: [ERROR] Cleanup after exit with status:22 (20170302 17:22:28.063) WSREP_SST: [INFO] Cleaning up temporary directories (20170302 17:22:28.066) 2017-03-02T17:22:28.095040Z 0 [ERROR] WSREP: Failed to read from: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'node2IP:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/data/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '40746209-d716-11e6-9299-6e180a3e767e:24295107' 2017-03-02T17:22:28.095075Z 0 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'node2IP:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/data/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-su ffix '' '' --gtid '40746209-d716-11e6-9299-6e180a3e767e:24295107': 22 (Invalid argument) 2017-03-02T17:22:28.095144Z 0 [ERROR] WSREP: Command did not run: wsrep_sst_xtrabackup-v2 --role 'donor' --address 'node2IP:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/data/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' '' --gtid '40746209-d716-11e6-9299-6e180a3e767e:24295107' 2017-03-02T17:22:28.095732Z 0 [Warning] WSREP: Could not find peer: c854375a-ff6c-11e6-a4d5-1e6aa96c7ab9 2017-03-02T17:22:28.095744Z 0 [Warning] WSREP: 0.0 (node1): State transfer to -1.-1 (left the group) failed: -22 (Invalid argument) 2017-03-02T17:22:28.095750Z 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 24295202) 2017-03-02T17:22:28.096021Z 0 [Note] WSREP: Member 0.0 (node1) synced with group. 2017-03-02T17:22:28.096031Z 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 24295202) 2017-03-02T17:22:28.096065Z 10 [Note] WSREP: Synchronized with group, ready for connections 2017-03-02T17:22:28.096082Z 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. node 1 innodbbackup logs Can't locate Digest/MD5.pm in @INC (@INC contains: /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at - line 693. BEGIN failed--compilation aborted at - line 693. 170302 17:22:27 Connecting to MySQL server host: localhost, user: sstuser, password: set, port: 0, socket: /var/lib/mysql/mysql.sock Using server version 5.7.16-10-57-log xtrabackup version 2.4.5 based on MySQL server 5.7.13 Linux (x86_64) (revision id: e41c0be) xtrabackup: uses posix_fadvise(). xtrabackup: cd to /data/mysql xtrabackup: open files limit requested 0, set to 5011 xtrabackup: using the following InnoDB configuration: xtrabackup: innodb_data_home_dir = . xtrabackup: innodb_data_file_path = ibdata1:12M:autoextend xtrabackup: innodb_log_group_home_dir = ./ xtrabackup: innodb_log_files_in_group = 2 xtrabackup: innodb_log_file_size = 50331648 InnoDB: Number of pools: 1 xtrabackup: Error writing file 'UNOPENED' (Errcode: 32 - Broken pipe) xb_stream_write_data() failed. xtrabackup: Error: write to logfile failed xtrabackup: Error writing file 'UNOPENED' (Errcode: 32 - Broken pipe) xtrabackup: Error: xtrabackup_copy_logfile() failed. node 2 2017-03-02T17:22:11.137602Z 0 [Warning] WSREP: Node is running in bootstrap/initialize mode. Disabling pxc_strict_mode checks 2017-03-02T17:22:11.139991Z 0 [Warning] No argument was provided to --log-bin, and --log-bin-index was not used; so replication may break when this MySQL server acts as a master and has his hostname changed!! Please use '--log-bin=db-mgmt-02-bin' to avoid this problem. 2017-03-02T17:22:11.142497Z 0 [Warning] InnoDB: Using innodb_locks_unsafe_for_binlog is DEPRECATED. This option may be removed in future releases. Please use READ COMMITTED transaction isolation level instead; Please refer to http://dev.mysql.com/doc/refman/5.7/en/set-transaction.html 2017-03-02T17:22:12.163150Z 0 [Warning] InnoDB: New log files created, LSN=45790 2017-03-02T17:22:12.218384Z 0 [Warning] InnoDB: Creating foreign key constraint system tables. 2017-03-02T17:22:12.277820Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: c5e0ddea-ff6c-11e6-8392-001e67e6c41e. 2017-03-02T17:22:12.278369Z 0 [Warning] Gtid table is not ready to be used. Table 'mysql.gtid_executed' cannot be opened. 2017-03-02T17:22:12.606329Z 0 [Warning] CA certificate ca.pem is self signed. 2017-03-02T17:22:12.765492Z 1 [Note] A temporary password is generated for root@localhost: 0pRAe/U)gW(q 2017-03-02T17:22:13.057233Z 1 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode. 2017-03-02T17:22:13.057278Z 1 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode. 2017-03-02T17:22:13.057291Z 1 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode. 2017-03-02T17:22:13.057302Z 1 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode. 2017-03-02T17:22:13.057331Z 1 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode. 2017-03-02T17:22:16.184722Z mysqld_safe Starting mysqld daemon with databases from /data/mysql 2017-03-02T17:22:16.189598Z mysqld_safe Skipping wsrep-recover for empty datadir: /data/mysql 2017-03-02T17:22:16.190854Z mysqld_safe Assigning 00000000-0000-0000-0000-000000000000:-1 to wsrep_start_position 2017-03-02T17:22:16.365350Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.16-10-57-log) starting as process 128979 ... 2017-03-02T17:22:16.368284Z 0 [Warning] No argument was provided to --log-bin, and --log-bin-index was not used; so replication may break when this MySQL server acts as a master and has his hostname changed!! Please use '--log-bin=db-mgmt-02-bin' to avoid this problem. 2017-03-02T17:22:16.368444Z 0 [Note] WSREP: Setting wsrep_ready to 0 2017-03-02T17:22:16.368453Z 0 [Note] WSREP: Read nil XID from storage engines, skipping position init 2017-03-02T17:22:16.368457Z 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/libgalera_smm.so' 2017-03-02T17:22:16.372150Z 0 [Note] WSREP: wsrep_load(): Galera 3.19(rb98f92f) by Codership Oy loaded successfully. 2017-03-02T17:22:16.372199Z 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2017-03-02T17:22:16.372529Z 0 [Warning] WSREP: Could not open state file for reading: '/data/mysql//grastate.dat' 2017-03-02T17:22:16.372637Z 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootsrap: 1 2017-03-02T17:22:16.376460Z 0 [Note] WSREP: Passing config to GCS: base_dir = /data/mysql/; base_host = node2IP; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /data/mysql/; gcache.keep_pages_count = 0; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /data/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = 1; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 1; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 7; socket.checksum = 2; socket.recv_buf_size = 212992; 2017-03-02T17:22:16.388295Z 0 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0) -> new(00000000-0000-0000-0000-000000000000:-1) 2017-03-02T17:22:16.388708Z 0 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2017-03-02T17:22:16.388753Z 0 [Note] WSREP: wsrep_sst_grab() 2017-03-02T17:22:16.388757Z 0 [Note] WSREP: Start replication 2017-03-02T17:22:16.388790Z 0 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2017-03-02T17:22:16.388865Z 0 [Note] WSREP: protonet asio version 0 2017-03-02T17:22:16.389002Z 0 [Note] WSREP: Using CRC-32C for message checksums. 2017-03-02T17:22:16.389032Z 0 [Note] WSREP: backend: asio 2017-03-02T17:22:16.389089Z 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2017-03-02T17:22:16.389178Z 0 [Warning] WSREP: access file(/data/mysql//gvwstate.dat) failed(No such file or directory) 2017-03-02T17:22:16.389184Z 0 [Note] WSREP: restore pc from disk failed 2017-03-02T17:22:16.389649Z 0 [Note] WSREP: GMCast version 0 2017-03-02T17:22:16.389877Z 0 [Note] WSREP: (c854375a, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2017-03-02T17:22:16.389888Z 0 [Note] WSREP: (c854375a, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2017-03-02T17:22:16.390171Z 0 [Note] WSREP: EVS version 0 2017-03-02T17:22:16.390260Z 0 [Note] WSREP: gcomm: connecting to group 'db-mgmt-pxc-cluster', peer 'node1IP:,node2IP:,garbdIP:' 2017-03-02T17:22:16.391637Z 0 [Note] WSREP: (c854375a, 'tcp://0.0.0.0:4567') connection established to c854375a tcp://node2IP:4567 2017-03-02T17:22:16.391654Z 0 [Warning] WSREP: (c854375a, 'tcp://0.0.0.0:4567') address 'tcp://node2IP:4567' points to own listening address, blacklisting 2017-03-02T17:22:16.392432Z 0 [Note] WSREP: (c854375a, 'tcp://0.0.0.0:4567') connection established to 507b3843 tcp://node1IP:4567 2017-03-02T17:22:16.392503Z 0 [Note] WSREP: (c854375a, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 2017-03-02T17:22:16.486037Z 0 [Note] WSREP: (c854375a, 'tcp://0.0.0.0:4567') connection established to 656c6320 tcp://garbdIP:4567 2017-03-02T17:22:16.521051Z 0 [Note] WSREP: declaring 507b3843 at tcp://node1IP:4567 stable 2017-03-02T17:22:16.521072Z 0 [Note] WSREP: declaring 656c6320 at tcp://garbdIP:4567 stable 2017-03-02T17:22:16.521450Z 0 [Note] WSREP: Node 507b3843 state prim 2017-03-02T17:22:16.521832Z 0 [Note] WSREP: view(view_id(PRIM,507b3843,321) memb { 507b3843,0 656c6320,0 c854375a,0 } joined { } left { } partitioned { }) 2017-03-02T17:22:16.521858Z 0 [Note] WSREP: save pc into disk 2017-03-02T17:22:16.891186Z 0 [Note] WSREP: gcomm: connected 2017-03-02T17:22:16.891209Z 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2017-03-02T17:22:16.891268Z 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2017-03-02T17:22:16.891273Z 0 [Note] WSREP: Opened channel 'db-mgmt-pxc-cluster' 2017-03-02T17:22:16.891397Z 0 [Note] WSREP: Waiting for SST to complete. 2017-03-02T17:22:16.891522Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2017-03-02T17:22:16.891560Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2017-03-02T17:22:16.891608Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb 2017-03-02T17:22:16.891635Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb from 0 (node1) 2017-03-02T17:22:16.891653Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb from 1 (garb) 2017-03-02T17:22:16.892430Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: c86849bb-ff6c-11e6-a86a-92ba08adbcfb from 2 (node2) 2017-03-02T17:22:16.892453Z 0 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 318, members = 2/3 (joined/total), act_id = 24295099, last_appl. = -1, protocols = 0/7/3 (gcs/repl/appl), group UUID = 40746209-d716-11e6-9299-6e180a3e767e 2017-03-02T17:22:16.892470Z 0 [Note] WSREP: Flow-control interval: [28, 28] 2017-03-02T17:22:16.892480Z 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 24295099) 2017-03-02T17:22:16.892598Z 2 [Note] WSREP: State transfer required: Group state: 40746209-d716-11e6-9299-6e180a3e767e:24295099 Local state: 00000000-0000-0000-0000-000000000000:-1 2017-03-02T17:22:16.892617Z 2 [Note] WSREP: New cluster view: global state: 40746209-d716-11e6-9299-6e180a3e767e:24295099, view# 319: Primary, number of nodes: 3, my index: 2, protocol version 3 2017-03-02T17:22:16.892625Z 2 [Warning] WSREP: Gap in state sequence. Need state transfer. 2017-03-02T17:22:16.892628Z 2 [Note] WSREP: Setting wsrep_ready to 0 2017-03-02T17:22:16.892756Z 0 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'joiner' --address 'node2IP' --datadir '/data/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '128979' '' ' WSREP_SST: [INFO] The xtrabackup version is 2.4.6 (20170302 17:22:16.920) WSREP_SST: [INFO] Streaming with xbstream (20170302 17:22:17.083) WSREP_SST: [INFO] Using socat as streamer (20170302 17:22:17.085) WSREP_SST: [INFO] Evaluating timeout -k 1810 1800 socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20170302 17:22:17.111) 2017-03-02T17:22:17.331308Z 2 [Note] WSREP: Prepared SST request: xtrabackup-v2|node2IP:4444/xtrabackup_sst//1 2017-03-02T17:22:17.331348Z 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2017-03-02T17:22:17.331365Z 2 [Note] WSREP: REPL Protocols: 7 (3, 2) 2017-03-02T17:22:17.331374Z 2 [Note] WSREP: Assign initial position for certification: 24295099, protocol version: 3 2017-03-02T17:22:17.331477Z 0 [Note] WSREP: Service thread queue flushed. 2017-03-02T17:22:17.331565Z 2 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (40746209-d716-11e6-9299-6e180a3e767e): 1 (Operation not permitted) at galera/src/replicator_str.cpp:prepare_for_IST():535. IST will be unavailable. 2017-03-02T17:22:17.332375Z 0 [Note] WSREP: Member 2.0 (node2) requested state transfer from '*any*'. Selected 0.0 (node1)(SYNCED) as donor. 2017-03-02T17:22:17.332395Z 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 24295107) 2017-03-02T17:22:17.332454Z 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2017-03-02T17:22:17.332485Z 2 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0) -> new(40746209-d716-11e6-9299-6e180a3e767e:24295099) WSREP_SST: [ERROR] Parent mysqld process (PID:128979) terminated unexpectedly. (20170302 17:22:17.601) WSREP_SST: [ERROR] Cleanup after exit with status:32 (20170302 17:22:17.603) 2017-03-02T17:22:17.609137Z 0 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address 'node2IP' --datadir '/data/mysql/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '128979' '' : 32 (Broken pipe) 2017-03-02T17:22:17.609176Z 0 [ERROR] WSREP: Failed to read uuid:seqno from joiner script. 2017-03-02T17:22:17.609185Z 0 [ERROR] WSREP: SST script aborted with error 32 (Broken pipe) 2017-03-02T17:22:17.609223Z 0 [ERROR] WSREP: SST failed: 32 (Broken pipe) 2017-03-02T17:22:17.609250Z 0 [ERROR] Aborting 2017-03-02T17:22:17.609263Z 0 [Note] WSREP: Signalling cancellation of the SST request. 2017-03-02T17:22:17.609302Z 0 [Note] WSREP: SST request was cancelled 2017-03-02T17:22:17.609375Z 2 [Note] WSREP: Closing send monitor... 2017-03-02T17:22:17.609391Z 2 [Note] WSREP: Closed send monitor. 2017-03-02T17:22:17.609402Z 2 [Note] WSREP: gcomm: terminating thread 2017-03-02T17:22:17.609412Z 2 [Note] WSREP: gcomm: joining thread 2017-03-02T17:22:17.609486Z 2 [Note] WSREP: gcomm: closing backend 2017-03-02T17:22:17.610265Z 2 [Note] WSREP: view(view_id(NON_PRIM,507b3843,321) memb { c854375a,0 } joined { } left { } partitioned { 507b3843,0 656c6320,0 }) 2017-03-02T17:22:17.610321Z 2 [Note] WSREP: view((empty)) 2017-03-02T17:22:17.610468Z 2 [Note] WSREP: gcomm: closed 2017-03-02T17:22:17.610491Z 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2017-03-02T17:22:17.610536Z 0 [Note] WSREP: Flow-control interval: [16, 16] 2017-03-02T17:22:17.610543Z 0 [Note] WSREP: Received NON-PRIMARY. 2017-03-02T17:22:17.610546Z 0 [Note] WSREP: Shifting JOINER -> OPEN (TO: 24295120) 2017-03-02T17:22:17.610570Z 0 [Note] WSREP: Received self-leave message. 2017-03-02T17:22:17.610574Z 0 [Note] WSREP: Flow-control interval: [0, 0] 2017-03-02T17:22:17.610577Z 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2017-03-02T17:22:17.610581Z 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 24295120) 2017-03-02T17:22:17.610586Z 0 [Note] WSREP: RECV thread exiting 0: Success 2017-03-02T17:22:17.610638Z 2 [Note] WSREP: recv_thread() joined. 2017-03-02T17:22:17.610644Z 2 [Note] WSREP: Closing replication queue. 2017-03-02T17:22:17.610646Z 2 [Note] WSREP: Closing slave action queue. 2017-03-02T17:22:19.609431Z 0 [Note] Forcefully disconnecting 2 remaining clients 2017-03-02T17:22:19.609456Z 0 [Note] WSREP: waiting for client connections to close: 2 2017-03-02T17:22:19.609477Z 0 [Note] WSREP: Service disconnected. 2017-03-02T17:22:19.609481Z 0 [Note] WSREP: closing connection 2 2017-03-02T17:22:19.609485Z 0 [Note] WSREP: closing connection 1 2017-03-02T17:22:19.609501Z 1 [Note] WSREP: WSREP rollback thread wakes for signal 2017-03-02T17:22:19.609518Z 1 [Note] WSREP: WSREP rollback thread has empty abort queue 2017-03-02T17:22:19.609522Z 1 [Note] WSREP: rollbacker thread exiting 2017-03-02T17:22:20.609574Z 0 [Note] WSREP: Some threads may fail to exit. 2017-03-02T17:22:20.609612Z 0 [Note] Binlog end 2017-03-02T17:22:20.609754Z 0 [Note] /usr/sbin/mysqld: Shutdown complete