Comment 2 for bug 1327763

Same thing happened today:

2014-06-09 10:03:41 7727 [Warning] WSREP: BF applier failed to open_and_lock_tables: 1615, fatal: 0 wsrep = (exec_mode: 1 conflict_state: 5 seqno: 11354082)
2014-06-09 10:03:41 7727 [Warning] WSREP: RBR event 3 Update_rows apply warning: 1615, 11354082
2014-06-09 10:03:41 7727 [Warning] WSREP: Failed to apply app buffer: seqno: 11354082, status: 1
         at galera/src/trx_handle.cpp:apply():340
Retrying 2th time
2014-06-09 10:03:41 7727 [Warning] WSREP: BF applier failed to open_and_lock_tables: 1615, fatal: 0 wsrep = (exec_mode: 1 conflict_state: 5 seqno: 11354082)
2014-06-09 10:03:41 7727 [Warning] WSREP: RBR event 3 Update_rows apply warning: 1615, 11354082
2014-06-09 10:03:41 7727 [Warning] WSREP: Failed to apply app buffer: seqno: 11354082, status: 1
         at galera/src/trx_handle.cpp:apply():340
Retrying 3th time
2014-06-09 10:03:41 7727 [Warning] WSREP: BF applier failed to open_and_lock_tables: 1615, fatal: 0 wsrep = (exec_mode: 1 conflict_state: 5 seqno: 11354082)
2014-06-09 10:03:41 7727 [Warning] WSREP: RBR event 3 Update_rows apply warning: 1615, 11354082
2014-06-09 10:03:41 7727 [Warning] WSREP: Failed to apply app buffer: seqno: 11354082, status: 1
         at galera/src/trx_handle.cpp:apply():340
Retrying 4th time
2014-06-09 10:03:41 7727 [Warning] WSREP: BF applier failed to open_and_lock_tables: 1615, fatal: 0 wsrep = (exec_mode: 1 conflict_state: 5 seqno: 11354082)
2014-06-09 10:03:41 7727 [Warning] WSREP: RBR event 3 Update_rows apply warning: 1615, 11354082
2014-06-09 10:03:41 7727 [Warning] WSREP: failed to replay trx: source: 762da368-ef4f-11e3-935b-f3bb661a8671 version: 3 local: 1 state: REPLAYING flags: 1 conn_id: 118117 trx_id: 4430490127 seqnos (l: 302245, g: 11354082, s: 11354076, d: 11354081, ts: 346572660163671)
2014-06-09 10:03:41 7727 [Warning] WSREP: Failed to apply trx 11354082 4 times
2014-06-09 10:03:41 7727 [ERROR] WSREP: trx_replay failed for: 6, query: void
2014-06-09 10:03:41 7727 [ERROR] Aborting

2014-06-09 10:03:43 7727 [Note] WSREP: killing local connection: 118122
2014-06-09 10:03:43 7727 [Note] WSREP: killing local connection: 118120
2014-06-09 10:03:43 7727 [Note] WSREP: Closing send monitor...
2014-06-09 10:03:43 7727 [Note] WSREP: Closed send monitor.
2014-06-09 10:03:43 7727 [Note] WSREP: gcomm: terminating thread
2014-06-09 10:03:43 7727 [Note] WSREP: gcomm: joining thread
2014-06-09 10:03:43 7727 [Note] WSREP: gcomm: closing backend
2014-06-09 10:03:44 7727 [Note] WSREP: view(view_id(NON_PRIM,04544223-ed52-11e3-b428-eebb72a5cca2,52) memb {
        762da368-ef4f-11e3-935b-f3bb661a8671,0
} joined {
} left {
} partitioned {
        04544223-ed52-11e3-b428-eebb72a5cca2,0
        09f6ccfa-e9c8-11e3-a608-6eeac628a08a,0
})
2014-06-09 10:03:44 7727 [Note] WSREP: view((empty))
2014-06-09 10:03:44 7727 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2014-06-09 10:03:44 7727 [Note] WSREP: gcomm: closed
2014-06-09 10:03:44 7727 [Note] WSREP: Flow-control interval: [16, 16]
2014-06-09 10:03:44 7727 [Note] WSREP: Received NON-PRIMARY.
2014-06-09 10:03:44 7727 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 11354114)
2014-06-09 10:03:44 7727 [Note] WSREP: Received self-leave message.
2014-06-09 10:03:44 7727 [Note] WSREP: Flow-control interval: [0, 0]
2014-06-09 10:03:44 7727 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2014-06-09 10:03:44 7727 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 11354114)
2014-06-09 10:03:44 7727 [Note] WSREP: RECV thread exiting 0: Success
2014-06-09 10:03:44 7727 [Note] WSREP: recv_thread() joined.
2014-06-09 10:03:44 7727 [Note] WSREP: Closing replication queue.
2014-06-09 10:03:44 7727 [Note] WSREP: Closing slave action queue.
2014-06-09 10:03:44 7727 [Note] WSREP: Service disconnected.
2014-06-09 10:03:44 7727 [Note] WSREP: rollbacker thread exiting
2014-06-09 10:03:45 7727 [Note] WSREP: Some threads may fail to exit.
2014-06-09 10:03:45 7727 [Note] Binlog end
2014-06-09 10:03:45 7727 [Note] Shutting down plugin 'partition'
....

key_buffer_size=12582912
read_buffer_size=131072
max_used_connections=27
max_threads=502
thread_count=12
connection_count=12
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 212606 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0xf815830
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f33d4fe1e20 thread_stack 0x30000
/usr/local/mysql/bin/mysqld(my_print_stacktrace+0x2c)[0x93b21c]
/usr/local/mysql/bin/mysqld(handle_fatal_signal+0x35f)[0x6967bf]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x10340)[0x7f33d5bd9340]
/usr/local/mysql/bin/mysqld[0x6b716b]
/usr/local/mysql/bin/mysqld[0x6b8049]
/usr/local/mysql/bin/mysqld[0x6b831e]
/usr/local/mysql/bin/mysqld[0x6a9f59]
/usr/local/mysql/bin/mysqld[0x6a9474]
/usr/local/mysql/bin/mysqld(_Z16acl_authenticateP3THDj+0x1c3)[0x6bd773]
/usr/local/mysql/bin/mysqld[0x6eead1]
/usr/local/mysql/bin/mysqld(_Z16login_connectionP3THD+0x3d)[0x6f008d]
/usr/local/mysql/bin/mysqld(_Z22thd_prepare_connectionP3THD+0x24)[0x6f0864]
/usr/local/mysql/bin/mysqld(_Z24do_handle_one_connectionP3THD+0x137)[0x6f0b97]
/usr/local/mysql/bin/mysqld(handle_one_connection+0x39)[0x6f0de9]
/usr/local/mysql/bin/mysqld(pfs_spawn_thread+0x140)[0xb9abd0]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8182)[0x7f33d5bd1182]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f33d50de30d]