Percona XtraDB Cluster node gets stuck in joining

Bug #1378138 reported by Marc Castrovinci
16
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Percona XtraBackup moved to https://jira.percona.com/projects/PXB
Expired
Undecided
Unassigned

Bug Description

When using xtrabackup version 2.2.4 or 2.2.5, percona cluster has an inconsistent report of the node being synced. Downgrading to 2.2.3 resolves the issue.

Steps to repeat:

apt-get install percona-xtradb-cluster-56
( should install the latest version of xtrabackup 2.2.5)

Packages installed as seen from apt:

ls /var/cache/apt/archives/*percona*

/var/cache/apt/archives/percona-toolkit_2.2.11_all.deb
/var/cache/apt/archives/percona-xtrabackup_2.2.5-5027-1.precise_amd64.deb
/var/cache/apt/archives/percona-xtradb-cluster-56_5.6.20-25.7-886.precise_amd64.deb
/var/cache/apt/archives/percona-xtradb-cluster-client-5.6_5.6.20-25.7-886.precise_amd64.deb
/var/cache/apt/archives/percona-xtradb-cluster-common-5.6_5.6.20-25.7-886.precise_amd64.deb
/var/cache/apt/archives/percona-xtradb-cluster-galera-3_3.7.3256.precise_amd64.deb
/var/cache/apt/archives/percona-xtradb-cluster-galera-3.x_3.7.3256.precise_amd64.deb
/var/cache/apt/archives/percona-xtradb-cluster-server-5.6_5.6.20-25.7-886.precise_amd64.deb

Bring up nodes:

Log from donor:
===================================
2014-10-06 23:37:56 30411 [Note] WSREP: SSL handshake successful, remote endpoint ssl://172.31.12.65:53627 local endpoint ssl://172.31.35.68:4567 cipher: AES128-SHA compression:
2014-10-06 23:37:56 30411 [Note] WSREP: (51a665e9, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2014-10-06 23:37:56 30411 [Note] WSREP: declaring cc905e66 at ssl://172.31.1x.6x:4567 stable
2014-10-06 23:37:56 30411 [Note] WSREP: declaring e7c165d0 at ssl://172.31.1x.9x:4567 stable
2014-10-06 23:37:56 30411 [Note] WSREP: Node 51a665e9 state prim
2014-10-06 23:37:56 30411 [Note] WSREP: save pc into disk
2014-10-06 23:37:56 30411 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2014-10-06 23:37:56 30411 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ccdbeebc-4db1-11e4-a6ec-832ef050b562
2014-10-06 23:37:56 30411 [Note] WSREP: STATE EXCHANGE: sent state msg: ccdbeebc-4db1-11e4-a6ec-832ef050b562
2014-10-06 23:37:56 30411 [Note] WSREP: STATE EXCHANGE: got state msg: ccdbeebc-4db1-11e4-a6ec-832ef050b562 from 0 (172.31.35.68)
2014-10-06 23:37:56 30411 [Note] WSREP: STATE EXCHANGE: got state msg: ccdbeebc-4db1-11e4-a6ec-832ef050b562 from 2 (172.31.18.95)
2014-10-06 23:37:57 30411 [Note] WSREP: STATE EXCHANGE: got state msg: ccdbeebc-4db1-11e4-a6ec-832ef050b562 from 1 (172.31.12.65)
2014-10-06 23:37:57 30411 [Note] WSREP: Quorum results:
        version = 3,
        component = PRIMARY,
        conf_id = 16,
        members = 2/3 (joined/total),
        act_id = 34,
        last_appl. = 0,
        protocols = 0/6/3 (gcs/repl/appl),
        group UUID = 51a6f655-4da7-11e4-a00b-46b455cf888f
2014-10-06 23:37:57 30411 [Note] WSREP: Flow-control interval: [28, 28]
2014-10-06 23:37:57 30411 [Note] WSREP: New cluster view: global state: 51a6f655-4da7-11e4-a00b-46b455cf888f:34, view# 17: Primary, number of nodes: 3, my index: 0, protocol version 3
2014-10-06 23:37:57 30411 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-10-06 23:37:57 30411 [Note] WSREP: REPL Protocols: 6 (3, 2)
2014-10-06 23:37:57 30411 [Note] WSREP: Service thread queue flushed.
2014-10-06 23:37:57 30411 [Note] WSREP: Assign initial position for certification: 34, protocol version: 3
2014-10-06 23:37:57 30411 [Note] WSREP: Service thread queue flushed.
2014-10-06 23:37:58 30411 [Note] WSREP: Member 1.0 (172.31.12.65) requested state transfer from '*any*'. Selected 0.0 (172.31.35.68)(SYNCED) as donor.
2014-10-06 23:37:58 30411 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 34)
2014-10-06 23:37:58 30411 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-10-06 23:37:58 30411 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'donor' --address '172.31.12.65:4444/xtrabackup_sst' --auth 'redacted:redacted' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --binlog 'mysql-bin' --gtid '51a6f655-4da7-11e4-a00b-46b455cf888f:34''
2014-10-06 23:37:58 30411 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20141006 23:37:58.460)
WSREP_SST: [INFO] Using socat as streamer (20141006 23:37:58.464)
WSREP_SST: [INFO] Using openssl based encryption with socat: with key and crt (20141006 23:37:58.474)
WSREP_SST: [INFO] Encrypting with certificate /etc/mysql/server-cert.pem, key /etc/mysql/server-key.pem (20141006 23:37:58.479)
WSREP_SST: [INFO] Using /tmp/tmp.y4HCqjrCdf as innobackupex temporary directory (20141006 23:37:58.728)
WSREP_SST: [INFO] Streaming GTID file before SST (20141006 23:37:58.732)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio openssl-connect:172.31.12.65:4444,cert=/etc/mysql/server-cert.pem,key=/etc/mysql/server-key.pem,verify=0; RC=( ${PIPESTATUS[@]} ) (20141006 23:37:58.737)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20141006 23:37:58.794)
2014-10-06 23:37:59 30411 [Note] WSREP: (51a665e9, 'ssl://0.0.0.0:4567') turning message relay requesting off
WSREP_SST: [INFO] Streaming the backup to joiner at 172.31.12.65 4444 (20141006 23:38:08.805)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/mysql/my.cnf --no-version-check $tmpopts $INNOEXTRA --galera-info --stream=$sfmt $itmpdir 2>${DATA}/innobackup.backup.log | socat -u stdio openssl-connect:172.31.12.65:4444,cert=/etc/mysql/server-cert.pem,key=/etc/mysql/server-key.pem,verify=0; RC=( ${PIPESTATUS[@]} ) (20141006 23:38:08.809)
2014-10-06 23:38:11 30411 [Note] WSREP: Provider paused at 51a6f655-4da7-11e4-a00b-46b455cf888f:34 (86)
2014-10-06 23:38:13 30411 [Note] WSREP: resuming provider at 86
2014-10-06 23:38:13 30411 [Note] WSREP: Provider resumed.
2014-10-06 23:38:13 30411 [Note] WSREP: 0.0 (172.31.35.68): State transfer to 1.0 (172.31.12.65) complete.
2014-10-06 23:38:13 30411 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 34)
2014-10-06 23:38:13 30411 [Note] WSREP: Member 0.0 (172.31.35.68) synced with group.
2014-10-06 23:38:13 30411 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 34)
2014-10-06 23:38:13 30411 [Note] WSREP: Synchronized with group, ready for connections
2014-10-06 23:38:13 30411 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
WSREP_SST: [INFO] Total time on donor: 0 seconds (20141006 23:38:13.529)
WSREP_SST: [INFO] Cleaning up temporary directories (20141006 23:38:13.535)
2014-10-06 23:38:21 30411 [Note] WSREP: 1.0 (172.31.12.65): State transfer from 0.0 (172.31.35.68) complete.
2014-10-06 23:38:21 30411 [Note] WSREP: Member 1.0 (172.31.12.65) synced with group.

================ we see it sync'd.

Check the node joining
=============================

mysql> mysql> show status like 'wsrep_local_state_comment';
+---------------------------+---------+
| Variable_name | Value |
+---------------------------+---------+
| wsrep_local_state_comment | Joining |
+---------------------------+---------+
1 row in set (0.00 sec)

mysql> show status like 'wsrep_cluster_status';
+----------------------+---------+
| Variable_name | Value |
+----------------------+---------+
| wsrep_cluster_status | Primary |
+----------------------+---------+
1 row in set (0.00 sec)

mysql> create database foobar;
ERROR 1047 (08S01): Unknown command

full wsrep
========================
+------------------------------+-------------------------------------------------------+
| Variable_name | Value |
+------------------------------+-------------------------------------------------------+
| wsrep_local_state_uuid | 51a6f655-4da7-11e4-a00b-46b455cf888f |
| wsrep_protocol_version | 6 |
| wsrep_last_committed | 30 |
| wsrep_replicated | 0 |
| wsrep_replicated_bytes | 0 |
| wsrep_repl_keys | 0 |
| wsrep_repl_keys_bytes | 0 |
| wsrep_repl_data_bytes | 0 |
| wsrep_repl_other_bytes | 0 |
| wsrep_received | 3 |
| wsrep_received_bytes | 308 |
| wsrep_local_commits | 0 |
| wsrep_local_cert_failures | 0 |
| wsrep_local_replays | 0 |
| wsrep_local_send_queue | 0 |
| wsrep_local_send_queue_max | 2 |
| wsrep_local_send_queue_min | 0 |
| wsrep_local_send_queue_avg | 0.333333 |
| wsrep_local_recv_queue | 0 |
| wsrep_local_recv_queue_max | 1 |
| wsrep_local_recv_queue_min | 0 |
| wsrep_local_recv_queue_avg | 0.000000 |
| wsrep_local_cached_downto | 18446744073709551615 |
| wsrep_flow_control_paused_ns | 0 |
| wsrep_flow_control_paused | 0.000000 |
| wsrep_flow_control_sent | 0 |
| wsrep_flow_control_recv | 0 |
| wsrep_cert_deps_distance | 0.000000 |
| wsrep_apply_oooe | 0.000000 |
| wsrep_apply_oool | 0.000000 |
| wsrep_apply_window | 0.000000 |
| wsrep_commit_oooe | 0.000000 |
| wsrep_commit_oool | 0.000000 |
| wsrep_commit_window | 0.000000 |
| wsrep_local_state | 1 |
| wsrep_local_state_comment | Joining |
| wsrep_cert_index_size | 0 |
| wsrep_causal_reads | 0 |
| wsrep_cert_interval | 0.000000 |
| wsrep_incoming_addresses | 172.31.35.68:3306,172.31.12.65:3306,172.31.18.95:3306 |
| wsrep_evs_repl_latency | 0/0/0/0/0 |
| wsrep_cluster_conf_id | 17 |
| wsrep_cluster_size | 3 |
| wsrep_cluster_state_uuid | 51a6f655-4da7-11e4-a00b-46b455cf888f |
| wsrep_cluster_status | Primary |
| wsrep_connected | ON |
| wsrep_local_bf_aborts | 0 |
| wsrep_local_index | 1 |
| wsrep_provider_name | Galera |
| wsrep_provider_vendor | Codership Oy <email address hidden> |
| wsrep_provider_version | 3.7(r7f44a18) |
| wsrep_ready | OFF |
+------------------------------+-------------------------------------------------------+

============== rollback to 2.2.3

on failed joining node, downgrade..

pkill -9 mysql
rm -rf /var/lib/mysql/*
wget http://www.percona.com/redir/downloads/XtraBackup/XtraBackup-2.2.3/binary/debian/precise/x86_64/percona-xtrabackup_2.2.3-4982-1.precise_amd64.deb

dpkg -i percona-xtrabackup_2.2.3-4982-1.precise_amd64.deb
dpkg: warning: downgrading percona-xtrabackup from 2.2.5-5027-1.precise to 2.2.3-4982-1.precise.
(Reading database ... 79323 files and directories currently installed.)
Preparing to replace percona-xtrabackup 2.2.5-5027-1.precise (using percona-xtrabackup_2.2.3-4982-1.precise_amd64.deb) ...
Unpacking replacement percona-xtrabackup ...
Setting up percona-xtrabackup (2.2.3-4982-1.precise) ...
root@ec2-54-165-154-128:~/a# xtrabackup --version
xtrabackup version 2.2.3 based on MySQL server 5.6.17 Linux (x86_64) (revision id: )

service mysql start

mysql> show status like 'wsrep_local_state_comment';
+---------------------------+--------+
| Variable_name | Value |
+---------------------------+--------+
| wsrep_local_state_comment | Synced |
+---------------------------+--------+
1 row in set (0.00 sec)

Log from donor:
===================================
2014-10-06 23:51:50 30411 [Note] WSREP: SSL handshake successful, remote endpoint ssl://172.31.12.65:53685 local endpoint ssl://172.31.35.68:4567 cipher: AES128-SHA compression:
2014-10-06 23:51:50 30411 [Note] WSREP: (51a665e9, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2014-10-06 23:51:51 30411 [Note] WSREP: declaring bddb8200 at ssl://172.31.x2.6x:4567 stable
2014-10-06 23:51:51 30411 [Note] WSREP: declaring e7c165d0 at ssl://172.31.x8.9x:4567 stable
2014-10-06 23:51:51 30411 [Note] WSREP: Node 51a665e9 state prim
2014-10-06 23:51:51 30411 [Note] WSREP: save pc into disk
2014-10-06 23:51:51 30411 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2014-10-06 23:51:51 30411 [Note] WSREP: STATE_EXCHANGE: sent state UUID: be2751bf-4db3-11e4-8f7c-af050cf9fc14
2014-10-06 23:51:51 30411 [Note] WSREP: STATE EXCHANGE: sent state msg: be2751bf-4db3-11e4-8f7c-af050cf9fc14
2014-10-06 23:51:51 30411 [Note] WSREP: STATE EXCHANGE: got state msg: be2751bf-4db3-11e4-8f7c-af050cf9fc14 from 0 (172.31.35.68)
2014-10-06 23:51:51 30411 [Note] WSREP: STATE EXCHANGE: got state msg: be2751bf-4db3-11e4-8f7c-af050cf9fc14 from 1 (172.31.12.65)
2014-10-06 23:51:51 30411 [Note] WSREP: STATE EXCHANGE: got state msg: be2751bf-4db3-11e4-8f7c-af050cf9fc14 from 2 (172.31.18.95)
2014-10-06 23:51:51 30411 [Note] WSREP: Quorum results:
        version = 3,
        component = PRIMARY,
        conf_id = 18,
        members = 2/3 (joined/total),
        act_id = 34,
        last_appl. = 0,
        protocols = 0/6/3 (gcs/repl/appl),
        group UUID = 51a6f655-4da7-11e4-a00b-46b455cf888f
2014-10-06 23:51:51 30411 [Note] WSREP: Flow-control interval: [28, 28]
2014-10-06 23:51:51 30411 [Note] WSREP: New cluster view: global state: 51a6f655-4da7-11e4-a00b-46b455cf888f:34, view# 19: Primary, number of nodes: 3, my index: 0, protocol version 3
2014-10-06 23:51:51 30411 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-10-06 23:51:51 30411 [Note] WSREP: REPL Protocols: 6 (3, 2)
2014-10-06 23:51:51 30411 [Note] WSREP: Service thread queue flushed.
2014-10-06 23:51:51 30411 [Note] WSREP: Assign initial position for certification: 34, protocol version: 3
2014-10-06 23:51:51 30411 [Note] WSREP: Service thread queue flushed.
2014-10-06 23:51:52 30411 [Note] WSREP: Member 1.0 (172.31.12.65) requested state transfer from '*any*'. Selected 0.0 (172.31.35.68)(SYNCED) as donor.
2014-10-06 23:51:52 30411 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 34)
2014-10-06 23:51:52 30411 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-10-06 23:51:52 30411 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'donor' --address '172.31.12.65:4444/xtrabackup_sst' --auth 'redacted:redacted' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --binlog 'mysql-bin' --gtid '51a6f655-4da7-11e4-a00b-46b455cf888f:34''
2014-10-06 23:51:52 30411 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20141006 23:51:52.288)
WSREP_SST: [INFO] Using socat as streamer (20141006 23:51:52.292)
WSREP_SST: [INFO] Using openssl based encryption with socat: with key and crt (20141006 23:51:52.303)
WSREP_SST: [INFO] Encrypting with certificate /etc/mysql/server-cert.pem, key /etc/mysql/server-key.pem (20141006 23:51:52.307)
WSREP_SST: [INFO] Using /tmp/tmp.kXWQezJ8L5 as innobackupex temporary directory (20141006 23:51:52.518)
WSREP_SST: [INFO] Streaming GTID file before SST (20141006 23:51:52.523)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio openssl-connect:172.31.12.65:4444,cert=/etc/mysql/server-cert.pem,key=/etc/mysql/server-key.pem,verify=0; RC=( ${PIPESTATUS[@]} ) (20141006 23:51:52.527)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20141006 23:51:52.586)
2014-10-06 23:51:53 30411 [Note] WSREP: (51a665e9, 'ssl://0.0.0.0:4567') turning message relay requesting off
WSREP_SST: [INFO] Streaming the backup to joiner at 172.31.12.65 4444 (20141006 23:52:02.592)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/mysql/my.cnf --no-version-check $tmpopts $INNOEXTRA --galera-info --stream=$sfmt $itmpdir 2>${DATA}/innobackup.backup.log | socat -u stdio openssl-connect:172.31.12.65:4444,cert=/etc/mysql/server-cert.pem,key=/etc/mysql/server-key.pem,verify=0; RC=( ${PIPESTATUS[@]} ) (20141006 23:52:02.597)
2014-10-06 23:52:04 30411 [Note] WSREP: Provider paused at 51a6f655-4da7-11e4-a00b-46b455cf888f:34 (92)
2014-10-06 23:52:07 30411 [Note] WSREP: resuming provider at 92
2014-10-06 23:52:07 30411 [Note] WSREP: Provider resumed.
2014-10-06 23:52:07 30411 [Note] WSREP: 0.0 (172.31.35.68): State transfer to 1.0 (172.31.12.65) complete.
2014-10-06 23:52:07 30411 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 34)
2014-10-06 23:52:07 30411 [Note] WSREP: Member 0.0 (172.31.35.68) synced with group.
2014-10-06 23:52:07 30411 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 34)
2014-10-06 23:52:07 30411 [Note] WSREP: Synchronized with group, ready for connections
2014-10-06 23:52:07 30411 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
WSREP_SST: [INFO] Total time on donor: 0 seconds (20141006 23:52:07.377)
WSREP_SST: [INFO] Cleaning up temporary directories (20141006 23:52:07.383)
2014-10-06 23:52:15 30411 [Note] WSREP: 1.0 (172.31.12.65): State transfer from 0.0 (172.31.35.68) complete.
2014-10-06 23:52:15 30411 [Note] WSREP: Member 1.0 (172.31.12.65) synced with group.

Revision history for this message
Raghavendra D Prabhu (raghavendra-prabhu) wrote :

@Marc,

Thanks for reporting the bug. Can you please share your cnf files?

Revision history for this message
Raghavendra D Prabhu (raghavendra-prabhu) wrote :

Also innobackupex logs if present, like in lp:1373796 from johan.

Revision history for this message
Marc Castrovinci (marc-castrovinci) wrote :
Revision history for this message
Marc Castrovinci (marc-castrovinci) wrote :
Revision history for this message
Marc Castrovinci (marc-castrovinci) wrote :
Revision history for this message
Nilnandan Joshi (nilnandan-joshi) wrote :
Download full text (3.6 KiB)

Unable to reproduce the same with PXC 5.6 + Xtrabackup 2.2.5. It doesn't stuck in joining. I can see in the donor log.

2014-10-14 15:08:28 10853 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'donor' --address '192.168.43.137:4444/xtrabackup_sst' --auth 'sst:secret' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' '' --gtid '3671fad1-123e-11e4-8ee5-7febff796263:13252''
2014-10-14 15:08:28 10853 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20141014 15:08:29.156)
WSREP_SST: [INFO] Using socat as streamer (20141014 15:08:29.158)
WSREP_SST: [INFO] Using /tmp/tmp.FIDW76ta2L as innobackupex temporary directory (20141014 15:08:29.343)
WSREP_SST: [INFO] Streaming GTID file before SST (20141014 15:08:29.350)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:192.168.43.137:4444; RC=( ${PIPESTATUS[@]} ) (20141014 15:08:29.353)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20141014 15:08:29.359)
WSREP_SST: [INFO] Streaming the backup to joiner at 192.168.43.137 4444 (20141014 15:08:39.367)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/mysql/my.cnf --no-version-check $tmpopts $INNOEXTRA --galera-info --stream=$sfmt $itmpdir 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:192.168.43.137:4444; RC=( ${PIPESTATUS[@]} ) (20141014 15:08:39.373)
2014-10-14 15:08:43 10853 [Note] WSREP: Provider paused at 3671fad1-123e-11e4-8ee5-7febff796263:13252 (17)
2014-10-14 15:08:45 10853 [Note] WSREP: resuming provider at 17
2014-10-14 15:08:45 10853 [Note] WSREP: Provider resumed.
2014-10-14 15:08:45 10853 [Note] WSREP: 0.0 (deb-pxc56-1): State transfer to 1.0 (deb-pxc56-2) complete.
2014-10-14 15:08:45 10853 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 13252)
2014-10-14 15:08:45 10853 [Note] WSREP: Member 0.0 (deb-pxc56-1) synced with group.
2014-10-14 15:08:45 10853 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 13252)
2014-10-14 15:08:45 10853 [Note] WSREP: Synchronized with group, ready for connections
2014-10-14 15:08:45 10853 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
WSREP_SST: [INFO] Total time on donor: 0 seconds (20141014 15:08:45.836)
WSREP_SST: [INFO] Cleaning up temporary directories (20141014 15:08:45.839)
2014-10-14 15:08:50 10853 [Note] WSREP: 1.0 (deb-pxc56-2): State transfer from 0.0 (deb-pxc56-1) complete.
2014-10-14 15:08:50 10853 [Note] WSREP: Member 1.0 (deb-pxc56-2) synced with group.

And on the node which is just joined.

root@deb-pxc56-2:/var/lib/mysql# mysql -uroot -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 35
Server version: 5.6.19-67.0-56 Percona XtraDB Cluster (GPL), Release 25.6, wsrep_25.6.r4111

Copyright (c) 2009-2014 Percona LLC and/or its affiliates
Copyright (c) 2000, 2014, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> show status like 'wsrep_loc...

Read more...

Changed in percona-xtrabackup:
status: New → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for Percona XtraBackup because there has been no activity for 60 days.]

Changed in percona-xtrabackup:
status: Incomplete → Expired
Revision history for this message
Shahriyar Rzayev (rzayev-sehriyar) wrote :

Percona now uses JIRA for bug reports so this bug report is migrated to: https://jira.percona.com/browse/PXB-1300

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.