Node stuck when performing FLUSH TABLES WITH READ LOCK; and DDL action.
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
MySQL patches by Codership | Status tracked in 5.6 | |||||
5.5 |
Fix Released
|
High
|
Seppo Jaakola | |||
5.6 |
Fix Released
|
High
|
Seppo Jaakola | |||
Percona XtraDB Cluster moved to https://jira.percona.com/projects/PXC | Status tracked in 5.6 | |||||
5.5 |
Fix Released
|
Undecided
|
Unassigned | |||
5.6 |
Fix Released
|
Undecided
|
Unassigned |
Bug Description
Node stuck when performing FLUSH TABLES WITH READ LOCK; and DDL action.
We had an issue while performing a simple operation that include FLUSH TABLES WITH READ LOCK; CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB;
Our setup is a simple 3 node using Percona PXC 5.5.34 OR 5.6.14.
The three nodes are new and not doing any insert.
We run the command as above on node1 in TRX A.
FLUSH TABLES WITH READ LOCK; CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB;
The server remain in :
2014-01-02 15:51:30 32587 [Note] WSREP: thread holds MDL locks at TI begin: CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB 1604
2014-01-02 15:51:30 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
not able to complete the DDL command:
(root@localhost:pm) [mysql]>show processlist;
+------
| Id | User | Host | db | Command | Time | State | Info | Rows_sent | Rows_examined |
+------
| 1 | system user | | NULL | Sleep | 1967 | NULL | NULL | 0 | 0 |
| 2 | system user | | NULL | Sleep | 1967 | wsrep aborter idle | NULL | 0 | 0 |
| 3 | system user | | NULL | Sleep | 1966 | NULL | NULL | 0 | 0 |
| 4 | system user | | NULL | Sleep | 1966 | NULL | NULL | 0 | 0 |
| 5 | system user | | NULL | Sleep | 1966 | NULL | NULL | 0 | 0 |
| 1303 | root | localhost | mysql | Query | 0 | init | show processlist | 0 | 0 |
| 1604 | root | localhost | mysql | Query | 694 | Preparing for TO isolation | CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB | 0 | 0 | <------
+------
7 rows in set (0.00 sec)
We then try to unlock the tables using a different connection on the same node.
So on node1 TRX B we run:
(root@
Query OK, 0 rows affected (0.00 sec)
Nothing happened:
| 1604 | root | localhost | mysql | Query | 807 | Preparing for TO isolation | CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB | 0 | 0 |
Also the error log is not reporting anything new.
So we kill the operation IN MySQL from TRX B:
KILL 1604;
At this point TRX A report:
ERROR 2013 (HY000): Lost connection to MySQL server during query
and the operation is mark as killed:
1604 | root | localhost | mysql | Killed | 1175 | Preparing for TO isolation | CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
On TRX A we try to run only the DDL statement CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB;
Again in the log we have:
2014-01-02 16:12:49 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
And the processlist report:
3161 | root | localhost | mysql | Query | 14 | Preparing for TO isolation | CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
At this point the only way to unlock the server is to restart it KILLING the process given it remain in pending state when try to stop it with mysqladministrator.
Doing the operation in a different way, using two connection it succeed.
In this test we will use 2 connections TRX A and B all on the same node Node1.
So on TRX A we issue:
(root@localhost:pm) [test]>FLUSH TABLES WITH READ LOCK;
Query OK, 0 rows affected (0.00 sec)
And in the log we have:
2014-01-02 16:35:30 13420 [Note] WSREP: Provider paused at b8aedb8b-
Then on TRX B we run:
CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB;
in the log we have:
2014-01-02 16:37:38 13420 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
And processlist report the action pending:
734 | root | localhost | mysql | Query | 72 | Preparing for TO isolation | CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB |
Issueing the UNLOCK on TRX A:
UNLOCK TABLES;
On TRX B:
Query OK, 0 rows affected (2 min 5.79 sec)
and log report:
2014-01-02 16:39:43 13420 [Note] WSREP: Provider resumed.
2014-01-02 16:39:43 13420 [Note] WSREP: TO BEGIN: 35, 2
2014-01-02 16:39:43 13420 [Note] WSREP: TO END: 35, 2 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
2014-01-02 16:39:43 13420 [Note] WSREP: TO END: 35
So all is executed fine.
This issue is then present only when you do FLUSH TABLE WITH READ LOCK; and DDL action in the connection.
How to replicate the issue
------
1) ON NODE 1, connection 1 execute FLUSH TABLES WITH READ LOCK; CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB;
2) ON NODE 2, try to perform UNLOCK TABLES; KILL etc
LOG
FIRST test that doesn not work
140102 15:30:17 mysqld_safe Starting mysqld daemon with databases from /home/mysql/
140102 15:30:17 mysqld_safe Skipping wsrep-recover for b8aedb8b-
140102 15:30:17 mysqld_safe Assigning b8aedb8b-
2014-01-02 15:30:17 0 [Note] WSREP: wsrep_start_
2014-01-02 15:30:17 32587 [Warning] You need to use --log-bin to make --log-slave-updates work.
2014-01-02 15:30:17 32587 [Note] WSREP: Setting wsrep_ready to 0
2014-01-02 15:30:17 32587 [Note] WSREP: Read nil XID from storage engines, skipping position init
2014-01-02 15:30:17 32587 [Note] WSREP: wsrep_load(): loading provider library '/home/
2014-01-02 15:30:17 32587 [Note] WSREP: wsrep_load(): Galera 3.1(r169) by Codership Oy <email address hidden> loaded successfully.
2014-01-02 15:30:17 32587 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
2014-01-02 15:30:17 32587 [Note] WSREP: Found saved state: b8aedb8b-
2014-01-02 15:30:17 32587 [Note] WSREP: Passing config to GCS: base_host = 192.168.0.35; base_port = 4567; cert.log_conflicts = no; evs.send_window = 1024; evs.user_
2014-01-02 15:30:17 32587 [Note] WSREP: Assign initial position for certification: 27, protocol version: -1
2014-01-02 15:30:17 32587 [Note] WSREP: wsrep_sst_grab()
2014-01-02 15:30:17 32587 [Note] WSREP: Start replication
2014-01-02 15:30:17 32587 [Note] WSREP: Setting initial position to b8aedb8b-
2014-01-02 15:30:17 32587 [Note] WSREP: protonet asio version 0
2014-01-02 15:30:17 32587 [Note] WSREP: Using CRC-32C (optimized) for message checksums.
2014-01-02 15:30:17 32587 [Note] WSREP: backend: asio
2014-01-02 15:30:17 32587 [Note] WSREP: GMCast version 0
2014-01-02 15:30:17 32587 [Note] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: EVS version 0
2014-01-02 15:30:17 32587 [Note] WSREP: PC version 0
2014-01-02 15:30:17 32587 [Note] WSREP: gcomm: connecting to group 'pxctest', peer '192.168.
2014-01-02 15:30:17 32587 [Warning] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: (b110cbac-
2014-01-02 15:30:17 32587 [Note] WSREP: declaring b82e00ed-
2014-01-02 15:30:17 32587 [Note] WSREP: declaring fb2a1879-
2014-01-02 15:30:17 32587 [Note] WSREP: Node b82e00ed-
2014-01-02 15:30:17 32587 [Note] WSREP: view(view_
b110cbac-
b82e00ed-
fb2a1879-
} joined {
} left {
} partitioned {
})
2014-01-02 15:30:17 32587 [Note] WSREP: gcomm: connected
2014-01-02 15:30:17 32587 [Note] WSREP: Changing maximum packet size to 129000, resulting msg size: 32636
2014-01-02 15:30:17 32587 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2014-01-02 15:30:17 32587 [Note] WSREP: Opened channel 'pxctest'
2014-01-02 15:30:17 32587 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2014-01-02 15:30:17 32587 [Note] WSREP: Waiting for SST to complete.
2014-01-02 15:30:17 32587 [Note] WSREP: STATE_EXCHANGE: sent state UUID: b15ea193-
2014-01-02 15:30:17 32587 [Note] WSREP: STATE EXCHANGE: sent state msg: b15ea193-
2014-01-02 15:30:17 32587 [Note] WSREP: STATE EXCHANGE: got state msg: b15ea193-
2014-01-02 15:30:17 32587 [Note] WSREP: STATE EXCHANGE: got state msg: b15ea193-
2014-01-02 15:30:17 32587 [Note] WSREP: STATE EXCHANGE: got state msg: b15ea193-
2014-01-02 15:30:17 32587 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf_id = 17,
members = 3/3 (joined/total),
act_id = 27,
last_appl. = -1,
protocols = 0/5/2 (gcs/repl/appl),
group UUID = b8aedb8b-
2014-01-02 15:30:17 32587 [Note] WSREP: Flow-control interval: [52, 52]
2014-01-02 15:30:17 32587 [Note] WSREP: Restored state OPEN -> JOINED (27)
2014-01-02 15:30:17 32587 [Note] WSREP: New cluster view: global state: b8aedb8b-
2014-01-02 15:30:17 32587 [Note] WSREP: SST complete, seqno: 27
2014-01-02 15:30:17 32587 [Warning] Using unique option prefix myisam-recover instead of myisam-
2014-01-02 15:30:17 32587 [Note] Plugin 'FEDERATED' is disabled.
2014-01-02 15:30:17 32587 [Note] WSREP: Member 0 (node1) synced with group.
2014-01-02 15:30:17 32587 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 27)
2014-01-02 15:30:17 32587 [Note] InnoDB: The InnoDB memory heap is disabled
2014-01-02 15:30:17 32587 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2014-01-02 15:30:17 32587 [Note] InnoDB: Compressed tables use zlib 1.2.3
2014-01-02 15:30:17 32587 [Note] InnoDB: Using Linux native AIO
2014-01-02 15:30:17 32587 [Note] InnoDB: Not using CPU crc32 instructions
2014-01-02 15:30:17 32587 [Note] InnoDB: Initializing buffer pool, size = 200.0M
2014-01-02 15:30:17 32587 [Note] InnoDB: Completed initialization of buffer pool
2014-01-02 15:30:17 32587 [Note] InnoDB: Highest supported file format is Barracuda.
2014-01-02 15:30:17 32587 [Note] InnoDB: 128 rollback segment(s) are active.
2014-01-02 15:30:17 32587 [Note] InnoDB: Waiting for purge to start
2014-01-02 15:30:18 32587 [Note] InnoDB: Percona XtraDB (http://
2014-01-02 15:30:18 32587 [Note] WSREP: Initial TC log open: dummy
2014-01-02 15:30:18 32587 [Note] RSA private key file not found: /home/mysql/
2014-01-02 15:30:18 32587 [Note] RSA public key file not found: /home/mysql/
2014-01-02 15:30:18 32587 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
2014-01-02 15:30:18 32587 [Note] - '0.0.0.0' resolves to '0.0.0.0';
2014-01-02 15:30:18 32587 [Note] Server socket created on IP: '0.0.0.0'.
2014-01-02 15:30:18 32587 [Warning] 'user' entry 'root@tusacentr
2014-01-02 15:30:18 32587 [Warning] 'proxies_priv' entry '@ root@tusacentral01' ignored in --skip-name-resolve mode.
2014-01-02 15:30:18 32587 [Note] Event Scheduler: Loaded 0 events
2014-01-02 15:30:18 32587 [Note] WSREP: Set WSREPXid for InnoDB: b8aedb8b-
2014-01-02 15:30:18 32587 [Note] WSREP: inited wsrep sidno 1
2014-01-02 15:30:18 32587 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-01-02 15:30:18 32587 [Note] /home/mysql/
Version: '5.6.14-25.1' socket: '/home/
2014-01-02 15:30:18 32587 [Note] WSREP: REPL Protocols: 5 (3, 1)
2014-01-02 15:30:18 32587 [Note] WSREP: Assign initial position for certification: 27, protocol version: 3
2014-01-02 15:30:18 32587 [Note] WSREP: Service thread queue flushed.
2014-01-02 15:30:18 32587 [Note] WSREP: Synchronized with group, ready for connections
2014-01-02 15:30:18 32587 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-01-02 15:51:30 32587 [Note] WSREP: Provider paused at b8aedb8b-
2014-01-02 15:51:30 32587 [Note] WSREP: thread holds MDL locks at TI begin: CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB 1604
2014-01-02 15:51:30 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
2014-01-02 16:12:49 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
2014-01-02 16:14:09 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest2 (a INT) ENGINE=INNODB
2014-01-02 16:15:02 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest2 (a INT) ENGINE=INNODB
2014-01-02 16:15:20 32587 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest2 (a INT) ENGINE=INNODB
Second TEST that works
140102 16:27:40 mysqld_safe Starting mysqld daemon with databases from /home/mysql/
140102 16:27:40 mysqld_safe Skipping wsrep-recover for b8aedb8b-
140102 16:27:40 mysqld_safe Assigning b8aedb8b-
2014-01-02 16:27:40 0 [Note] WSREP: wsrep_start_
2014-01-02 16:27:40 13420 [Warning] You need to use --log-bin to make --log-slave-updates work.
2014-01-02 16:27:40 13420 [Note] WSREP: Setting wsrep_ready to 0
2014-01-02 16:27:40 13420 [Note] WSREP: Read nil XID from storage engines, skipping position init
2014-01-02 16:27:40 13420 [Note] WSREP: wsrep_load(): loading provider library '/home/
2014-01-02 16:27:40 13420 [Note] WSREP: wsrep_load(): Galera 3.1(r169) by Codership Oy <email address hidden> loaded successfully.
2014-01-02 16:27:40 13420 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
2014-01-02 16:27:40 13420 [Note] WSREP: Found saved state: b8aedb8b-
2014-01-02 16:27:40 13420 [Note] WSREP: Passing config to GCS: base_host = 192.168.0.35; base_port = 4567; cert.log_conflicts = no; evs.send_window = 1024; evs.user_
2014-01-02 16:27:40 13420 [Note] WSREP: Assign initial position for certification: 27, protocol version: -1
2014-01-02 16:27:40 13420 [Note] WSREP: wsrep_sst_grab()
2014-01-02 16:27:40 13420 [Note] WSREP: Start replication
2014-01-02 16:27:40 13420 [Note] WSREP: Setting initial position to b8aedb8b-
2014-01-02 16:27:40 13420 [Note] WSREP: protonet asio version 0
2014-01-02 16:27:40 13420 [Note] WSREP: Using CRC-32C (optimized) for message checksums.
2014-01-02 16:27:40 13420 [Note] WSREP: backend: asio
2014-01-02 16:27:40 13420 [Note] WSREP: GMCast version 0
2014-01-02 16:27:40 13420 [Note] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: EVS version 0
2014-01-02 16:27:40 13420 [Note] WSREP: PC version 0
2014-01-02 16:27:40 13420 [Note] WSREP: gcomm: connecting to group 'pxctest', peer '192.168.
2014-01-02 16:27:40 13420 [Warning] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: (b53d8c69-
2014-01-02 16:27:40 13420 [Note] WSREP: declaring b82e00ed-
2014-01-02 16:27:40 13420 [Note] WSREP: declaring fb2a1879-
2014-01-02 16:27:40 13420 [Note] WSREP: Node b82e00ed-
2014-01-02 16:27:40 13420 [Note] WSREP: view(view_
b53d8c69-
b82e00ed-
fb2a1879-
} joined {
} left {
} partitioned {
})
2014-01-02 16:27:40 13420 [Note] WSREP: gcomm: connected
2014-01-02 16:27:40 13420 [Note] WSREP: Changing maximum packet size to 129000, resulting msg size: 32636
2014-01-02 16:27:40 13420 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2014-01-02 16:27:40 13420 [Note] WSREP: Opened channel 'pxctest'
2014-01-02 16:27:40 13420 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2014-01-02 16:27:40 13420 [Note] WSREP: Waiting for SST to complete.
2014-01-02 16:27:40 13420 [Note] WSREP: STATE_EXCHANGE: sent state UUID: b58b7387-
2014-01-02 16:27:40 13420 [Note] WSREP: STATE EXCHANGE: sent state msg: b58b7387-
2014-01-02 16:27:40 13420 [Note] WSREP: STATE EXCHANGE: got state msg: b58b7387-
2014-01-02 16:27:40 13420 [Note] WSREP: STATE EXCHANGE: got state msg: b58b7387-
2014-01-02 16:27:40 13420 [Note] WSREP: STATE EXCHANGE: got state msg: b58b7387-
2014-01-02 16:27:40 13420 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf_id = 19,
members = 2/3 (joined/total),
act_id = 32,
last_appl. = -1,
protocols = 0/5/2 (gcs/repl/appl),
group UUID = b8aedb8b-
2014-01-02 16:27:40 13420 [Note] WSREP: Flow-control interval: [52, 52]
2014-01-02 16:27:40 13420 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 32)
2014-01-02 16:27:40 13420 [Note] WSREP: State transfer required:
Group state: b8aedb8b-
Local state: b8aedb8b-
2014-01-02 16:27:40 13420 [Note] WSREP: New cluster view: global state: b8aedb8b-
2014-01-02 16:27:40 13420 [Warning] WSREP: Gap in state sequence. Need state transfer.
2014-01-02 16:27:40 13420 [Note] WSREP: Setting wsrep_ready to 0
2014-01-02 16:27:40 13420 [Note] WSREP: [debug]: closing client connections for PRIM
2014-01-02 16:27:42 13420 [Note] WSREP: waiting for client connections to close: 2
2014-01-02 16:27:42 13420 [Note] WSREP: Running: 'wsrep_
WSREP_SST: [INFO] Streaming with tar (20140102 16:27:42.792)
WSREP_SST: [INFO] Using socat as streamer (20140102 16:27:42.795)
2014-01-02 16:27:42 13420 [Note] WSREP: Prepared SST request: xtrabackup|
2014-01-02 16:27:42 13420 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-01-02 16:27:42 13420 [Note] WSREP: REPL Protocols: 5 (3, 1)
2014-01-02 16:27:42 13420 [Note] WSREP: Assign initial position for certification: 32, protocol version: 3
2014-01-02 16:27:42 13420 [Note] WSREP: Service thread queue flushed.
2014-01-02 16:27:42 13420 [Note] WSREP: Prepared IST receiver, listening at: tcp://192.
2014-01-02 16:27:42 13420 [Note] WSREP: Node 0.0 (node1) requested state transfer from '*any*'. Selected 1.0 (node1)(SYNCED) as donor.
2014-01-02 16:27:42 13420 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 32)
2014-01-02 16:27:42 13420 [Note] WSREP: Requesting state transfer: success, donor: 1
WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:
tar: xtrabackup_
tar: xtrabackup_ist: time stamp 2014-01-02 16:28:13 is 29.893577406 s in the future
WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST (20140102 16:27:43.130)
WSREP_SST: [INFO] Total time on joiner: 0 seconds (20140102 16:27:43.133)
WSREP_SST: [INFO] Removing the sst_in_progress file (20140102 16:27:43.135)
2014-01-02 16:27:43 13420 [Note] WSREP: SST complete, seqno: 27
2014-01-02 16:27:43 13420 [Warning] Using unique option prefix myisam-recover instead of myisam-
2014-01-02 16:27:43 13420 [Note] Plugin 'FEDERATED' is disabled.
2014-01-02 16:27:43 13420 [Note] InnoDB: The InnoDB memory heap is disabled
2014-01-02 16:27:43 13420 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2014-01-02 16:27:43 13420 [Note] InnoDB: Compressed tables use zlib 1.2.3
2014-01-02 16:27:43 13420 [Note] InnoDB: Using Linux native AIO
2014-01-02 16:27:43 13420 [Note] InnoDB: Not using CPU crc32 instructions
2014-01-02 16:27:43 13420 [Note] InnoDB: Initializing buffer pool, size = 200.0M
2014-01-02 16:27:43 13420 [Note] InnoDB: Completed initialization of buffer pool
2014-01-02 16:27:43 13420 [Note] InnoDB: Highest supported file format is Barracuda.
2014-01-02 16:27:43 13420 [Note] InnoDB: The log sequence numbers 1665787 and 1665787 in ibdata files do not match the log sequence number 1665951 in the ib_logfiles!
2014-01-02 16:27:43 13420 [Note] InnoDB: Database was not shutdown normally!
2014-01-02 16:27:43 13420 [Note] InnoDB: Starting crash recovery.
2014-01-02 16:27:43 13420 [Note] InnoDB: Reading tablespace information from the .ibd files...
2014-01-02 16:27:43 13420 [Note] InnoDB: Restoring possible half-written data pages
2014-01-02 16:27:43 13420 [Note] InnoDB: from the doublewrite buffer...
2014-01-02 16:27:43 13420 [Note] InnoDB: 128 rollback segment(s) are active.
2014-01-02 16:27:43 13420 [Note] InnoDB: Waiting for purge to start
2014-01-02 16:27:43 13420 [Note] InnoDB: Percona XtraDB (http://
2014-01-02 16:27:43 13420 [Note] WSREP: Initial TC log open: dummy
2014-01-02 16:27:43 13420 [Note] RSA private key file not found: /home/mysql/
2014-01-02 16:27:43 13420 [Note] RSA public key file not found: /home/mysql/
2014-01-02 16:27:43 13420 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
2014-01-02 16:27:43 13420 [Note] - '0.0.0.0' resolves to '0.0.0.0';
2014-01-02 16:27:43 13420 [Note] Server socket created on IP: '0.0.0.0'.
2014-01-02 16:27:43 13420 [Warning] 'user' entry 'root@tusacentr
2014-01-02 16:27:43 13420 [Warning] 'proxies_priv' entry '@ root@tusacentral01' ignored in --skip-name-resolve mode.
2014-01-02 16:27:43 13420 [Note] Event Scheduler: Loaded 0 events
2014-01-02 16:27:43 13420 [Note] WSREP: Signalling provider to continue.
2014-01-02 16:27:43 13420 [Note] WSREP: inited wsrep sidno 1
2014-01-02 16:27:43 13420 [Note] WSREP: SST received: b8aedb8b-
2014-01-02 16:27:43 13420 [Note] WSREP: Receiving IST: 5 writesets, seqnos 27-32
2014-01-02 16:27:43 13420 [Note] /home/mysql/
Version: '5.6.14-25.1' socket: '/home/
2014-01-02 16:27:44 13420 [Note] WSREP: 1.0 (node1): State transfer to 0.0 (node1) complete.
2014-01-02 16:27:44 13420 [Note] WSREP: Member 1 (node1) synced with group.
2014-01-02 16:27:44 13420 [Note] WSREP: IST received: b8aedb8b-
2014-01-02 16:27:44 13420 [Note] WSREP: 0.0 (node1): State transfer from 1.0 (node1) complete.
2014-01-02 16:27:44 13420 [Note] WSREP: Shifting JOINER -> JOINED (TO: 32)
2014-01-02 16:27:44 13420 [Note] WSREP: Member 0 (node1) synced with group.
2014-01-02 16:27:44 13420 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 32)
2014-01-02 16:27:44 13420 [Note] WSREP: Synchronized with group, ready for connections
2014-01-02 16:27:44 13420 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-01-02 16:35:30 13420 [Note] WSREP: Provider paused at b8aedb8b-
2014-01-02 16:37:38 13420 [Note] WSREP: TO BEGIN: -1, 0 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
2014-01-02 16:39:43 13420 [Note] WSREP: Provider resumed.
2014-01-02 16:39:43 13420 [Note] WSREP: TO BEGIN: 35, 2
2014-01-02 16:39:43 13420 [Note] WSREP: TO END: 35, 2 : CREATE TABLE IF NOT EXISTS test.mytest (a INT) ENGINE=INNODB
2014-01-02 16:39:43 13420 [Note] WSREP: TO END: 35
Hi Marco,
At first glance this is an expected behavior. The same will happen with any write you want to replicate.
The way it is implemented right now FTWRL pretty much makes the node read-only. Is it a problem?