I can only normal shutdown write node.
Read node shutdown logs:
#######error.log#######
121112 19:42:13 [Note] /usr/local/Percona-XtraDB-Cluster-5.5.27-23.6.356.Linux.x86_64/bin/mysqld: Normal shutdown
121112 19:42:13 [Note] WSREP: Stop replication
121112 19:42:13 [Note] WSREP: Provider disconnect
121112 19:42:13 [Note] WSREP: Closing send monitor...
121112 19:42:13 [Note] WSREP: Closed send monitor.
121112 19:42:13 [Note] WSREP: closing connection 74
121112 19:42:13 [Note] WSREP: Before Lock_thread_count
121112 19:42:15 [Note] WSREP: waiting for client connections to close: 33 (Wait a long time .... no next response ....)
#######error.log#######
I've got a three node xtradb cluster.
Sysbench command: #sysbench# ##### 20;i++, i++,i++ )); do sysbench --test=oltp --mysql- host=10. 10.59.51 --mysql-port=5003 --mysql-user=testu --mysql- password= testp --mysql-db=sbtest --mysql- table-engine= innodb --mysql- engine- trx=yes --oltp- table-size= 400000000 --num-threads= ${i}00 --max-time=0 --max-requests=0 run;date; done ####### ######
#######
for ((i=1;i<
#######
When --num-threads > 500 , mysql error log print(sometimes) : error.log# ###### 2c9f-11e2- 0800-f27a6d19a1 30, 'tcp:// 10.10.59. 230:5030' ) turning message relay requesting off 2c9f-11e2- 0800-f27a6d19a1 30, 'tcp:// 10.10.59. 230:5030' ) cleaning up duplicate 0x7f74b801b0e0 after established 0x2b71870 version= 0,type= 1,user_ type=255, order=0, seq=975216, seq_range= 0,aru_seq= 974414, flags=4, source= ffc955be- 2c92-11e2- 0800-658df0cf61 e1,source_ view_id= view_id( REG,52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,5),range_ uuid=00000000- 0000-0000- 0000-0000000000 00,range= [-1,-1] ,fifo_seq= 2474613, node_list= () evs::proto( 52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30, OPERATIONAL, view_id( REG,52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,5)), OPERATIONAL) { view=view( view_id( REG,52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,5) memb {
52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,
54808247- 2c93-11e2- 0800-d94fc5e26d 6e,
ffc955be- 2c92-11e2- 0800-658df0cf61 e1, evs::input_ map: {aru_seq= 974410, safe_seq= 974410, node_index= node: {idx=0, range=[ 974671, 974670] ,safe_seq= 974410} node: {idx=1, range=[ 974415, 974414] ,safe_seq= 974410} node: {idx=2, range=[ 974411, 975216] ,safe_seq= 974414} ,msg_index= (0,974414) ,evs::msg{ version= 0,type= 1,user_ type=255, order=0, seq=974414, seq_range= 0,aru_seq= 974410, flags=0, source= 52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,source_ view_id= view_id( REG,52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,5),range_ uuid=00000000- 0000-0000- 0000-0000000000 00,range= [-1,-1] ,fifo_seq= 1948755, node_list= ()
(1,974414) ,evs::msg{ version= 0,type= 1,user_ type=255, order=0, se range.get_ hs() == last_msg_seq: evs::msg{ version= 0,type= 1,user_ type=255, order=0, seq=974415, seq_range= 255,aru_ seq=974410, flags=0, source= 52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,source_ view_id= view_id( REG,52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,5),range_ uuid=00000000- 0000-0000- 0000-0000000000 00,range= [-1,-1] ,fifo_seq= 1948757, node_list= () 974410, safe_seq= 974410, node_index= node: {idx=0, range=[ 974671, 974670] ,safe_seq= 974410} node: {idx=1, range=[ 974415, 974414] ,safe_seq= 974410} node: {idx=2, range=[ 974411, 975216] ,safe_seq= 974414} ,msg_index= (0,974414) ,evs::msg{ version= 0,type= 1,user_ type=255, order=0, seq=974414, seq_range= 0,aru_seq= 974410, flags=0, source= 52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,source_ view_id= view_id( REG,52d1b2b7- 2c9f-11e2- 0800-f27a6d19a1 30,5),range_ uuid=00000000- 0000-0000- 0000-0000000000 00,range= [-1,-1] ,fifo_seq= 1948755, node_list= ()
(1,974414) ,evs::msg{ version= 0,type= 1,user_ type=255, order=0, seq=974414, seq_range= 0,aru_seq= 974410, error.log# ######
#######
121112 17:15:22 [Note] WSREP: (52d1b2b7-
121112 17:15:22 [Note] WSREP: (52d1b2b7-
121112 17:15:24 [Warning] WSREP: readjusting seq range 801 to 255
121112 17:15:24 [ERROR] WSREP: exception caused by message: evs::msg{
}
121112 17:15:24 [ERROR] WSREP: state after handling message: evs::proto(
current_
} joined {
} left {
} partitioned {
}),
input_map=
}
121112 17:15:24 [ERROR] WSREP: exception from gcomm, backend must be restarted:
} evs::input_map: {aru_seq=
}
121112 17:15:24 [Note] WSREP: Received self-leave message.
121112 17:15:24 [Note] WSREP: Flow-control interval: [0, 0]
121112 17:15:24 [Note] WSREP: Received SELF-LEAVE. Closing connection.
121112 17:15:24 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 1229737)
121112 17:15:24 [Note] WSREP: RECV thread exiting 0: Success
#######
All cluster nodes status like this: ------- ------- ------- -+----- ------- ------- ------- ------- -----+ ------- ------- ------- -+----- ------- ------- ------- ------- -----+ state_uuid | 23b36a90- 299b-11e2- 0800-0494f50ee1 f9 | version | 4 | committed | 2110735 | d_bytes | 329257886 | bytes | 7307 | cert_failures | 0 | bf_aborts | 0 | send_queue | 0 | send_queue_ avg | 0.000000 | recv_queue | 0 | recv_queue_ avg | 0.000000 | control_ paused | 0.000000 | control_ sent | 0 | control_ recv | 0 | deps_distance | 1793.307719 | state_comment | Initialized (0) | index_size | 8627 | conf_id | 184467440737095 51615 | state_uuid | 23b36a90- 299b-11e2- 0800-0494f50ee1 f9 | status | non-Primary | vendor | Codership Oy <email address hidden> | version | 2.2(r115) | ------- ------- ------- -+----- ------- ------- ------- ------- -----+
mysql> show status like 'wsrep%';
+------
| Variable_name | Value |
+------
| wsrep_local_
| wsrep_protocol_
| wsrep_last_
| wsrep_replicated | 238039 |
| wsrep_replicate
| wsrep_received | 770 |
| wsrep_received_
| wsrep_local_commits | 238039 |
| wsrep_local_
| wsrep_local_
| wsrep_local_replays | 0 |
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_local_
| wsrep_flow_
| wsrep_flow_
| wsrep_flow_
| wsrep_cert_
| wsrep_apply_oooe | 0.000000 |
| wsrep_apply_oool | 0.000000 |
| wsrep_apply_window | 0.000000 |
| wsrep_commit_oooe | 0.000000 |
| wsrep_commit_oool | 0.000000 |
| wsrep_commit_window | 0.000000 |
| wsrep_local_state | 0 |
| wsrep_local_
| wsrep_cert_
| wsrep_causal_reads | 0 |
| wsrep_cluster_
| wsrep_cluster_size | 2 |
| wsrep_cluster_
| wsrep_cluster_
| wsrep_connected | ON |
| wsrep_local_index | 0 |
| wsrep_provider_name | Galera |
| wsrep_provider_
| wsrep_provider_
| wsrep_ready | OFF |
+------
I can only normal shutdown write node. error.log# ###### Percona- XtraDB- Cluster- 5.5.27- 23.6.356. Linux.x86_ 64/bin/ mysqld: Normal shutdown
Read node shutdown logs:
#######
121112 19:42:13 [Note] /usr/local/
121112 19:42:13 [Note] WSREP: Stop replication error.log# ######
121112 19:42:13 [Note] WSREP: Provider disconnect
121112 19:42:13 [Note] WSREP: Closing send monitor...
121112 19:42:13 [Note] WSREP: Closed send monitor.
121112 19:42:13 [Note] WSREP: closing connection 74
121112 19:42:13 [Note] WSREP: Before Lock_thread_count
121112 19:42:15 [Note] WSREP: waiting for client connections to close: 33 (Wait a long time .... no next response ....)
#######