Freshly started joiner gets stuck in joining state
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Percona XtraDB Cluster moved to https://jira.percona.com/projects/PXC |
New
|
Undecided
|
Unassigned |
Bug Description
I have an intermittent problem with freshly installed nodes (nodes with a clean datadir and fresh package install via vagrant) that get wedged in a 'Joining' state.
[root@pxc3 mysql]# mysql -e "show global status like 'wsrep%'"
+------
| Variable_name | Value |
+------
| wsrep_local_
| wsrep_protocol_
| wsrep_last_
| wsrep_replicated | 0 |
| wsrep_replicate
| wsrep_repl_keys | 0 |
| wsrep_repl_
| wsrep_repl_
| wsrep_repl_
| wsrep_received | 2 |
| wsrep_received_
| wsrep_local_commits | 0 |
| wsrep_local_
| wsrep_local_replays | 0 |
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_flow_
| wsrep_flow_
| wsrep_flow_
| wsrep_flow_
| wsrep_cert_
| wsrep_apply_oooe | 0.000000 |
| wsrep_apply_oool | 0.000000 |
| wsrep_apply_window | 0.000000 |
| wsrep_commit_oooe | 0.000000 |
| wsrep_commit_oool | 0.000000 |
| wsrep_commit_window | 0.000000 |
| wsrep_local_state | 1 |
| wsrep_local_
| wsrep_cert_
| wsrep_causal_reads | 0 |
| wsrep_cert_interval | 0.000000 |
| wsrep_incoming_
| wsrep_evs_delayed | |
| wsrep_evs_
| wsrep_evs_
| wsrep_evs_state | OPERATIONAL |
| wsrep_gcomm_uuid | 67850d43-
| wsrep_cluster_
| wsrep_cluster_size | 3 |
| wsrep_cluster_
| wsrep_cluster_
| wsrep_connected | ON |
| wsrep_local_
| wsrep_local_index | 1 |
| wsrep_provider_name | Galera |
| wsrep_provider_
| wsrep_provider_
| wsrep_ready | OFF |
+------
The node is stuck and I have to kill it. After restarting mysqld, it joins the cluster fine and normally. I cannot reproduce the 'Joining' wedge after the first time unless I rebuild the entire node from scratch.
Oddly, the other nodes see it as a member of the cluster and it receives replication (wsrep_
[root@pxc3 mysql]# rpm -qa | grep -i percona
percona-
percona-
Percona-
Percona-
Percona-
Percona-
Percona-
I will attach the error log.
Corresponding Galera ticket: https:/ /github. com/codership/ galera/ issues/ 143