| 2012-12-10 09:10:53 |
Joep |
bug |
|
|
added bug |
| 2012-12-10 15:48:14 |
Vadim Tkachenko |
bug task added |
|
codership-mysql |
|
| 2012-12-10 16:54:58 |
Raghavendra D Prabhu |
affects |
percona-server |
percona-xtradb-cluster |
|
| 2012-12-14 17:13:48 |
Joep |
description |
The mysqld process crashes after only a few queries. From this error, it's impossible to see what went wrong. Could be a bug, could be an error on our end, but there's no way to tell.
Setup:
3 - node cluster (test setup)
All on virtual machines 2 CPU / 2 GB (node3, 4 & 5)
All InnoDB
Relevant my.cnf parts: (taken from node3)
----------------------------------------------------------------------------------------------------------------------------
# CACHES AND LIMITS #
tmp_table_size = 32M
max_heap_table_size = 32M
query_cache_type = 0
query_cache_size = 0
max_connections = 200
thread_cache_size = 20
open_files_limit = 65535
table_definition_cache = 4096
table_open_cache = 4096
# INNODB #
innodb_flush_method = O_DIRECT
innodb_log_files_in_group = 2
innodb_log_file_size = 128M
innodb_flush_log_at_trx_commit = 2
innodb_file_per_table = 1
innodb_buffer_pool_size = 1488M
server_id=1
wsrep_cluster_address="gcomm://node4,node5"
wsrep_provider=/usr/lib/libgalera_smm.so
wsrep_provider_options = "gmcast.listen_addr=tcp://node3; sst.recv_addr=node3; evs.keepalive_period = PT3S; evs.inactive_check_period = PT10S; evs.suspect_timeout = PT30S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M"
wsrep_slave_threads=2
wsrep_cluster_name=**removed**
wsrep_sst_method=xtrabackup
wsrep_sst_auth=root:**removed**
wsrep_node_name=node3
wsrep_node_incoming_address="node3:4567"
wsrep_node_address="node3"
innodb_locks_unsafe_for_binlog=1
innodb_autoinc_lock_mode=2
----------------------------------------------------------------------------------------------------------------------------
Crash happens also when running only 1 node
Percona Xtradb cluster Version 5.5.28
*no* messages of any importance before first message in trace below
Information about "no such a transition COMMITTING -> REPLICATING" nowhere to be found (manual, forum, documentation, google) but that could also be a lack of searching skills on my end.
==================================================================
121210 9:52:52 [ERROR] WSREP: FSM: no such a transition COMMITTING -> REPLICATING
08:52:52 UTC - mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Please help us make Percona Server better by reporting any
bugs at http://bugs.percona.com/
key_buffer_size=33554432
read_buffer_size=131072
max_used_connections=7
max_threads=200
thread_count=6
connection_count=6
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 470497 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x520a080
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f802ede8e20 thread_stack 0x40000
mysqld(my_print_stacktrace+0x2e)[0x7cd73e]
mysqld(handle_fatal_signal+0x481)[0x6b1681]
/lib/x86_64-linux-gnu/libpthread.so.0(+0xfcb0)[0x7f802e027cb0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35)[0x7f802dc8f425]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b)[0x7f802dc92b8b]
/usr/lib/libgalera_smm.so(_ZN6galera3FSMINS_9TrxHandle5StateENS1_10TransitionENS_10EmptyGuardENS_11EmptyActionEE8shift_toES2_+0x180)[0x7f802c799070]
/usr/lib/libgalera_smm.so(_ZN6galera13ReplicatorSMM9replicateEPNS_9TrxHandleE+0xc5)[0x7f802c78efb5]
/usr/lib/libgalera_smm.so(galera_pre_commit+0xb0)[0x7f802c7a1680]
mysqld(_Z22wsrep_run_wsrep_commitP3THDP10handlertonb+0x753)[0x667c63]
mysqld[0x6689fb]
mysqld(_Z15ha_commit_transP3THDb+0x13b)[0x6b42eb]
mysqld(_Z17trans_commit_stmtP3THD+0x25)[0x65d515]
mysqld(_Z21mysql_execute_commandP3THD+0x63c)[0x5ac45c]
mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x2d1)[0x5b29f1]
mysqld[0x5b2b62]
mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x16b9)[0x5b4e79]
mysqld(_Z10do_commandP3THD+0x171)[0x5b5521]
mysqld(_Z24do_handle_one_connectionP3THD+0x180)[0x64fcd0]
mysqld(handle_one_connection+0x51)[0x64fe91]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)[0x7f802e01fe9a]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f802dd4ccbd]
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f7f90004c50): is an invalid pointer
Connection ID (thread ID): 44
Status: NOT_KILLED
================================================================== |
The mysqld process crashes after only a few queries. From this error, it's impossible to see what went wrong. Could be a bug, could be an error on our end, but there's no way to tell.
Setup:
3 - node cluster (test setup)
All on virtual machines 2 CPU / 2 GB (node3, 4 & 5)
All InnoDB
Relevant my.cnf parts: (taken from node3)
----------------------------------------------------------------------------------------------------------------------------
# CACHES AND LIMITS #
tmp_table_size = 32M
max_heap_table_size = 32M
query_cache_type = 0
query_cache_size = 0
max_connections = 200
thread_cache_size = 20
open_files_limit = 65535
table_definition_cache = 4096
table_open_cache = 4096
# INNODB #
innodb_flush_method = O_DIRECT
innodb_log_files_in_group = 2
innodb_log_file_size = 128M
innodb_flush_log_at_trx_commit = 2
innodb_file_per_table = 1
innodb_buffer_pool_size = 1488M
server_id=1
wsrep_cluster_address="gcomm://node4,node5"
wsrep_provider=/usr/lib/libgalera_smm.so
wsrep_provider_options = "gmcast.listen_addr=tcp://node3; sst.recv_addr=node3; evs.keepalive_period = PT3S; evs.inactive_check_period = PT10S; evs.suspect_timeout = PT30S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M"
wsrep_slave_threads=2
wsrep_cluster_name=**removed**
wsrep_sst_method=xtrabackup
wsrep_sst_auth=root:**removed**
wsrep_node_name=node3
wsrep_node_incoming_address="node3:4567"
wsrep_node_address="node3"
innodb_locks_unsafe_for_binlog=1
innodb_autoinc_lock_mode=2
----------------------------------------------------------------------------------------------------------------------------
Crash happens also when running only 1 node
Percona Xtradb cluster Version 5.5.28
*no* messages of any importance before first message in trace below
Information about "no such a transition COMMITTING -> REPLICATING" nowhere to be found (manual, forum, documentation, google) but that could also be a lack of searching skills on my end.
==================================================================
121210 9:52:52 [ERROR] WSREP: FSM: no such a transition COMMITTING -> REPLICATING
08:52:52 UTC - mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Please help us make Percona Server better by reporting any
bugs at http://bugs.percona.com/
key_buffer_size=33554432
read_buffer_size=131072
max_used_connections=7
max_threads=200
thread_count=6
connection_count=6
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 470497 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x520a080
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f802ede8e20 thread_stack 0x40000
mysqld(my_print_stacktrace+0x2e)[0x7cd73e]
mysqld(handle_fatal_signal+0x481)[0x6b1681]
/lib/x86_64-linux-gnu/libpthread.so.0(+0xfcb0)[0x7f802e027cb0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35)[0x7f802dc8f425]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b)[0x7f802dc92b8b]
/usr/lib/libgalera_smm.so(_ZN6galera3FSMINS_9TrxHandle5StateENS1_10TransitionENS_10EmptyGuardENS_11EmptyActionEE8shift_toES2_+0x180)[0x7f802c799070]
/usr/lib/libgalera_smm.so(_ZN6galera13ReplicatorSMM9replicateEPNS_9TrxHandleE+0xc5)[0x7f802c78efb5]
/usr/lib/libgalera_smm.so(galera_pre_commit+0xb0)[0x7f802c7a1680]
mysqld(_Z22wsrep_run_wsrep_commitP3THDP10handlertonb+0x753)[0x667c63]
mysqld[0x6689fb]
mysqld(_Z15ha_commit_transP3THDb+0x13b)[0x6b42eb]
mysqld(_Z17trans_commit_stmtP3THD+0x25)[0x65d515]
mysqld(_Z21mysql_execute_commandP3THD+0x63c)[0x5ac45c]
mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x2d1)[0x5b29f1]
mysqld[0x5b2b62]
mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x16b9)[0x5b4e79]
mysqld(_Z10do_commandP3THD+0x171)[0x5b5521]
mysqld(_Z24do_handle_one_connectionP3THD+0x180)[0x64fcd0]
mysqld(handle_one_connection+0x51)[0x64fe91]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)[0x7f802e01fe9a]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f802dd4ccbd]
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f7f90004c50): is an invalid pointer
Connection ID (thread ID): 44
Status: NOT_KILLED
================================================================== |
|
| 2012-12-17 23:19:45 |
Vadim Tkachenko |
percona-xtradb-cluster: status |
New |
Confirmed |
|
| 2012-12-17 23:19:49 |
Vadim Tkachenko |
codership-mysql: status |
New |
Confirmed |
|
| 2012-12-18 09:06:40 |
Seppo Jaakola |
codership-mysql: assignee |
|
Seppo Jaakola (seppo-jaakola) |
|
| 2012-12-18 09:06:47 |
Seppo Jaakola |
codership-mysql: milestone |
|
5.5.28-23.8 |
|
| 2012-12-18 10:50:31 |
Seppo Jaakola |
codership-mysql: status |
Confirmed |
In Progress |
|
| 2012-12-18 11:05:02 |
Seppo Jaakola |
codership-mysql: importance |
Undecided |
Low |
|
| 2012-12-18 15:01:28 |
Seppo Jaakola |
codership-mysql: status |
In Progress |
Fix Committed |
|
| 2013-01-09 17:57:16 |
Vadim Tkachenko |
percona-xtradb-cluster: milestone |
|
5.5.29-23.8 |
|
| 2013-01-22 17:40:59 |
Vadim Tkachenko |
percona-xtradb-cluster: milestone |
5.5.29-23.8 |
5.5.29-27.3.1 |
|
| 2013-01-22 17:41:03 |
Vadim Tkachenko |
percona-xtradb-cluster: status |
Confirmed |
Fix Committed |
|
| 2013-01-22 17:43:25 |
Vadim Tkachenko |
percona-xtradb-cluster: milestone |
5.5.29-27.3.1 |
5.5.29-23.7.1 |
|
| 2013-01-22 18:58:09 |
Seppo Jaakola |
codership-mysql: milestone |
5.5.29-24.8 |
5.5.29-23.7.1 |
|
| 2013-01-31 16:31:15 |
Vadim Tkachenko |
percona-xtradb-cluster: status |
Fix Committed |
Fix Released |
|
| 2013-03-11 14:47:44 |
Alex Yurchenko |
codership-mysql: status |
Fix Committed |
Fix Released |
|
| 2013-10-01 16:51:20 |
Raghavendra D Prabhu |
nominated for series |
|
percona-xtradb-cluster/5.6 |
|
| 2013-10-01 16:51:20 |
Raghavendra D Prabhu |
bug task added |
|
percona-xtradb-cluster/5.6 |
|
| 2013-10-01 16:51:20 |
Raghavendra D Prabhu |
nominated for series |
|
percona-xtradb-cluster/trunk |
|
| 2013-10-01 16:51:20 |
Raghavendra D Prabhu |
bug task added |
|
percona-xtradb-cluster/trunk |
|
| 2013-10-01 16:51:37 |
Raghavendra D Prabhu |
percona-xtradb-cluster/5.6: milestone |
|
5.6.13-24.0 |
|
| 2013-10-03 18:22:57 |
Raghavendra D Prabhu |
percona-xtradb-cluster/5.6: milestone |
5.6.13-24.0 |
|
|
| 2013-10-03 18:23:01 |
Raghavendra D Prabhu |
bug task deleted |
percona-xtradb-cluster/5.6 |
|
|
| 2016-03-09 03:36:55 |
markus_albe |
tags |
|
i66437 |
|
