Activity log for bug #1208921

Date Who What changed Old value New value Message
2013-08-06 16:57:24 Raghavendra D Prabhu bug added bug
2013-08-06 16:59:00 Raghavendra D Prabhu bug task added codership-mysql
2013-08-06 16:59:58 Raghavendra D Prabhu description Repeatable with RQG with galera grammar: Hope that's ok; if not, decrease some variables in the equation. [2/740] [1/740] Thread pointer: 0x28cc5a0 [0/740] Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 7fb9345b5e68 thread_stack 0x40000 /chip/bin/mysqld(my_print_stacktrace+0x2c)[0x8007ca] /chip/bin/mysqld(handle_fatal_signal+0x2f9)[0x6c256d] /usr/lib/libpthread.so.0(+0xf0e0)[0x7fb946c310e0] /usr/lib/libc.so.6(gsignal+0x39)[0x7fb9453e01c9] /usr/lib/libc.so.6(abort+0x148)[0x7fb9453e15c8] /chip/bin/mysqld[0x815a1b] /chip/bin/mysqld(_ZN12ha_partition10unlock_rowEv+0x4a)[0xa1774e] /chip/bin/mysqld(_Z8filesortP3THDP5TABLEP13st_sort_fieldjP10SQL_SELECTybPy+0x1af6)[0x6c1483] /chip/bin/mysqld(_Z12mysql_deleteP3THDP10TABLE_LISTP4ItemP10SQL_I_ListI8st_orderEyy+0x808)[0x7b76ab] /chip/bin/mysqld(_Z21mysql_execute_commandP3THD+0x34a8)[0x59ff10] /chip/bin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x142)[0x5a52e8] /chip/bin/mysqld[0x5a5dfb] /chip/bin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x994)[0x5a6d02] /chip/bin/mysqld(_Z10do_commandP3THD+0x679)[0x5a8bd3] /chip/bin/mysqld(_Z24do_handle_one_connectionP3THD+0x13a)[0x64fbfd] /chip/bin/mysqld(handle_one_connection+0x49)[0x64fded] /usr/lib/libpthread.so.0(+0x7dd2)[0x7fb946c29dd2] /usr/lib/libc.so.6(clone+0x6d)[0x7fb945490cdd] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (7fb900004c10): DELETE IGNORE FROM `table10000_innodb_key_pk_parts_2_int` WHERE `col_char_12_key` IN ( SELECT `col_char_12_key` FROM `table1_innodb_int` WHERE `pk` = 0 ) ORDER BY `col_char_12`,`col_char_12_k ey`,`col_int`,`col_int_key`,`pk` LIMIT 3 Connection ID (thread ID): 10 Status: NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file # 2013-08-06T22:18:32 [41182] datadir is /chip/mysql-test/var/node0/data/ # 2013-08-06T22:18:32 [41182] binary is /chip/../chip/bin/mysqld # 2013-08-06T22:18:32 [41182] bindir is /chip/../chip/bin # 2013-08-06T22:18:32 [41182] WARNING: Core file not found! "/media/Tintin/Work/code/randgen/mariadb-patches" is not a core dump: Is a directory backtrace.gdb:19: Error in sourced command file: No stack. # 2013-08-06T22:18:33 [41182] Whether to confirm potentially dangerous operations is on. "/media/Tintin/Work/code/randgen/mariadb-patches" is not a core dump: Is a directory # 2013-08-06T22:18:33 [41182] Whether to confirm potentially dangerous operations is on. # 2013-08-06T22:18:33 [41182] Test completed with failure status STATUS_SERVER_CRASHED (101) # 2013-08-06T22:18:33 [41182] GenTest exited with exit status STATUS_SERVER_CRASHED (101) # 2013-08-06T22:18:33 [41182] Stopping server on port 19300 # 2013-08-06T22:18:33 [41182] Stale connection. Reconnecting # 2013-08-06T22:18:33 [41182] Reconnect failed due to 2003:Can't connect to MySQL server on '127.0.0.1' (111) # 2013-08-06T22:18:33 [41182] Server would not shut down properly. Terminate it # 2013-08-06T22:18:33 [41182] Terminated process 41533 # 2013-08-06T22:18:33 [41182] Stopping server on port 19301 # 2013-08-06T22:18:33 [41182] Stale connection. Reconnecting # 2013-08-06T22:18:33 [41182] [41182] runall-new.pl will exit with exit status STATUS_SERVER_CRASHED (101) ============================================================================================== Cmdline: perl runall-new.pl --basedir=/chip --galera=ms --grammar=$PWD/conf/galera/galera_stress.yy --gendata=$PWD/conf/galera/galera_stress.zz --threads=10 --queries=1000000 --mysqld=--wsrep-provider=/pxc/lib/libgalera_smm.so The galera grammar from: bzr+ssh://bazaar.launchpad.net/~elenst/randgen/mariadb-patches/ Repeatable with RQG with galera grammar: # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41740... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41732... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41753... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41751... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41749... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41730... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41728... # 2013-08-06T22:18:31 [41182] Killing remaining worker process with pid 41757... # 2013-08-06T22:18:32 [41182] Killing periodic reporting process with pid 41727... # 2013-08-06T22:18:32 [41182] Kill GenTest::ErrorFilter(41726) # 2013-08-06T22:18:32 [41182] Server crash reported, initiating post-crash analysis... # 2013-08-06T22:18:32 [41182] The last 100 lines from /chip/mysql-test/var/node0/data//../mysql.err : 130806 22:18:24 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:24 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:25 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:25 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:28 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:30 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 [ERROR] /chip/bin/mysqld: Sort aborted: Deadlock found when trying to get lock; try restarting transaction 130806 22:18:31 InnoDB: Assertion failure in thread 140433424082688 in file ha_innodb.cc line 6207 InnoDB: Failing assertion: prebuilt->trx->conc_state == 1 InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.5/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. 16:48:31 UTC - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=8388608 read_buffer_size=131072 max_used_connections=13 max_threads=151 thread_count=13 connection_count=13 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 338557 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x28cc5a0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 7fb9345b5e68 thread_stack 0x40000 /chip/bin/mysqld(my_print_stacktrace+0x2c)[0x8007ca] /chip/bin/mysqld(handle_fatal_signal+0x2f9)[0x6c256d] /usr/lib/libpthread.so.0(+0xf0e0)[0x7fb946c310e0] /usr/lib/libc.so.6(gsignal+0x39)[0x7fb9453e01c9] /usr/lib/libc.so.6(abort+0x148)[0x7fb9453e15c8] /chip/bin/mysqld[0x815a1b] /chip/bin/mysqld(_ZN12ha_partition10unlock_rowEv+0x4a)[0xa1774e] /chip/bin/mysqld(_Z8filesortP3THDP5TABLEP13st_sort_fieldjP10SQL_SELECTybPy+0x1af6)[0x6c1483] /chip/bin/mysqld(_Z12mysql_deleteP3THDP10TABLE_LISTP4ItemP10SQL_I_ListI8st_orderEyy+0x808)[0x7b76ab] /chip/bin/mysqld(_Z21mysql_execute_commandP3THD+0x34a8)[0x59ff10] /chip/bin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x142)[0x5a52e8] /chip/bin/mysqld[0x5a5dfb] /chip/bin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x994)[0x5a6d02] /chip/bin/mysqld(_Z10do_commandP3THD+0x679)[0x5a8bd3] /chip/bin/mysqld(_Z24do_handle_one_connectionP3THD+0x13a)[0x64fbfd] /chip/bin/mysqld(handle_one_connection+0x49)[0x64fded] /usr/lib/libpthread.so.0(+0x7dd2)[0x7fb946c29dd2] /usr/lib/libc.so.6(clone+0x6d)[0x7fb945490cdd] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (7fb900004c10): DELETE IGNORE FROM `table10000_innodb_key_pk_parts_2_int` WHERE `col_char_12_key` IN ( SELECT `col_char_12_key` FROM `table1_innodb_int` WHERE `pk` = 0 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 3 Connection ID (thread ID): 10 Status: NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file # 2013-08-06T22:18:32 [41182] datadir is /chip/mysql-test/var/node0/data/ # 2013-08-06T22:18:32 [41182] binary is /chip/../chip/bin/mysqld # 2013-08-06T22:18:32 [41182] bindir is /chip/../chip/bin # 2013-08-06T22:18:32 [41182] WARNING: Core file not found! "/media/Tintin/Work/code/randgen/mariadb-patches" is not a core dump: Is a directory backtrace.gdb:19: Error in sourced command file: No stack. # 2013-08-06T22:18:33 [41182] Whether to confirm potentially dangerous operations is on. "/media/Tintin/Work/code/randgen/mariadb-patches" is not a core dump: Is a directory # 2013-08-06T22:18:33 [41182] Whether to confirm potentially dangerous operations is on. # 2013-08-06T22:18:33 [41182] Test completed with failure status STATUS_SERVER_CRASHED (101) # 2013-08-06T22:18:33 [41182] GenTest exited with exit status STATUS_SERVER_CRASHED (101) # 2013-08-06T22:18:33 [41182] Stopping server on port 19300 # 2013-08-06T22:18:33 [41182] Stale connection. Reconnecting # 2013-08-06T22:18:33 [41182] Reconnect failed due to 2003:Can't connect to MySQL server on '127.0.0.1' (111) # 2013-08-06T22:18:33 [41182] Server would not shut down properly. Terminate it # 2013-08-06T22:18:33 [41182] Terminated process 41533 # 2013-08-06T22:18:33 [41182] Stopping server on port 19301 # 2013-08-06T22:18:33 [41182] Stale connection. Reconnecting # 2013-08-06T22:18:33 [41182] [41182] runall-new.pl will exit with exit status STATUS_SERVER_CRASHED (101) Cmdline: perl runall-new.pl --basedir=/chip --galera=ms --grammar=$PWD/conf/galera/galera_stress.yy --gendata=$PWD/conf/galera/galera_stress.zz --threads=10 --queries=1000000 --mysqld=--wsrep-provider=/pxc/lib/libgalera_smm.so The galera grammar from: bzr+ssh://bazaar.launchpad.net/~elenst/randgen/mariadb-patches/
2013-08-08 00:08:40 Raghavendra D Prabhu bug task added percona-server
2013-08-08 00:12:53 Roel Van de Paar nominated for series percona-server/5.1
2013-08-08 00:12:53 Roel Van de Paar bug task added percona-server/5.1
2013-08-08 00:12:53 Roel Van de Paar nominated for series percona-server/5.5
2013-08-08 00:12:53 Roel Van de Paar bug task added percona-server/5.5
2013-08-08 00:12:53 Roel Van de Paar nominated for series percona-server/5.6
2013-08-08 00:12:53 Roel Van de Paar bug task added percona-server/5.6
2013-08-08 00:14:58 Raghavendra D Prabhu summary Assertion failure in thread 140433424082688 in file ha_innodb.cc line 6207 | prebuilt->trx->conc_state == 1 Assertion failure in thread 140433424082688 in file ha_innodb.cc line 6207 | prebuilt->trx->conc_state == 1 | prebuilt->trx->state == 1 (in case of PS)
2013-08-08 10:15:10 Valerii Kravchuk bug watch added http://bugs.mysql.com/bug.php?id=69127
2013-08-08 10:17:14 Valerii Kravchuk bug task added mysql-server
2013-08-08 15:05:17 Raghavendra D Prabhu mysql-server: importance Unknown Undecided
2013-08-08 15:05:17 Raghavendra D Prabhu mysql-server: status Unknown New
2013-08-08 15:05:17 Raghavendra D Prabhu mysql-server: remote watch MySQL Bug System #69127
2013-08-09 04:38:04 Raghavendra D Prabhu attachment added full-bt https://bugs.launchpad.net/percona-xtradb-cluster/+bug/1208921/+attachment/3765687/+files/full-bt
2013-08-09 05:51:42 Raghavendra D Prabhu bug watch added http://bugs.mysql.com/bug.php?id=69969
2013-08-09 05:52:07 Raghavendra D Prabhu mysql-server: importance Undecided Unknown
2013-08-09 05:52:07 Raghavendra D Prabhu mysql-server: status New Unknown
2013-08-09 05:52:07 Raghavendra D Prabhu mysql-server: remote watch MySQL Bug System #69969
2013-08-09 07:28:59 Laurynas Biveinis tags upstream
2013-12-19 15:13:31 Valerii Kravchuk percona-server/5.5: status New Confirmed
2013-12-19 15:14:02 Valerii Kravchuk nominated for series percona-xtradb-cluster/5.6
2013-12-19 15:14:02 Valerii Kravchuk bug task added percona-xtradb-cluster/5.6
2013-12-19 15:14:02 Valerii Kravchuk nominated for series percona-xtradb-cluster/trunk
2013-12-19 15:14:02 Valerii Kravchuk bug task added percona-xtradb-cluster/trunk
2013-12-19 15:14:22 Valerii Kravchuk percona-xtradb-cluster/trunk: status New Confirmed
2013-12-20 03:50:40 Laurynas Biveinis percona-server/5.5: importance Undecided High
2013-12-20 03:50:42 Laurynas Biveinis percona-server/5.5: status Confirmed Triaged
2014-03-27 13:29:29 Laurynas Biveinis percona-server/5.1: milestone 5.5.37-35.0
2014-03-27 13:29:36 Laurynas Biveinis percona-server/5.1: milestone 5.5.37-35.0
2014-03-27 13:29:39 Laurynas Biveinis percona-server/5.5: milestone 5.5.37-35.0
2014-03-27 13:41:01 Laurynas Biveinis percona-server/5.6: status New Triaged
2014-03-27 13:41:07 Laurynas Biveinis percona-server/5.6: importance Undecided High
2014-03-27 13:41:29 Laurynas Biveinis percona-server/5.6: milestone 5.6.17-65.0
2014-03-27 15:47:05 Launchpad Janitor branch linked lp:~laurynas-biveinis/percona-server/merge-5.5.37
2014-03-27 16:09:51 Laurynas Biveinis percona-server/5.5: status Triaged Fix Committed
2014-03-28 14:07:25 Laurynas Biveinis percona-server/5.5: status Fix Committed Fix Released
2014-03-29 17:35:13 Launchpad Janitor branch linked lp:~laurynas-biveinis/percona-server/merge-5.6.17
2014-03-29 17:40:03 Laurynas Biveinis percona-server/5.6: status Triaged Fix Committed
2014-04-25 10:42:16 Laurynas Biveinis percona-server/5.6: status Fix Committed Fix Released
2015-11-17 08:19:44 Krunal Bauskar percona-xtradb-cluster/5.5: status Confirmed Fix Committed
2015-11-17 08:19:50 Krunal Bauskar percona-xtradb-cluster/5.5: importance Undecided High
2015-11-17 08:19:52 Krunal Bauskar percona-xtradb-cluster/5.6: status New Fix Committed
2015-11-17 08:19:54 Krunal Bauskar percona-xtradb-cluster/5.6: importance Undecided High
2016-03-30 12:15:52 Laurynas Biveinis percona-server/5.1: status New Won't Fix